Signs of Surveillance:

An essay on Signs of Surveillance

Daniel Buzzo: from

“The Arts, Design and Technology” Editors: Rae Earnshaw, Susan Liggett. Springer (2020)

Abstract

This writing discusses the challenges of working with complex digital in- formation, visual images, meta-data and temporal and geo-spatial information, as raw materials for artistic expression. In the chapter the reader will have an insight into the thought process and working practice, artistic and technical, of forming in- formation into a recognisable body of work and processing both the content and the form of the work into an emotional, reflective experience. Discussing the challenges of working with external, commercial software frameworks and web services and the challenge of dealing with the brittleness of digital things but also the ’semantic affordance’ offered by computer systems in working at a conceptual level with art materials. The ’Signs of Surveillance’ project originated as a photographic observation and collation activity in early 2015 and has grown to a complex digital web and installation live visualisation project. Since that time thousands of photographs of signs of surveillance, those warning signs indicating an area or activity is being monitored by video-camera, have been captured in more than 15 countries including Belgium, Canada, China, Denmark, France, Germany, Greece, Italy, Japan, Korea, Luxembourg, Netherlands, Portugal, Spain, Sweden, and UK. This chapter dis- cusses the development of one aspect of this multi-part work, dealing directly with managing and manipulating a large body of digital data and working with complex visualisation systems and online and offline digital distribution technology.

1 Keywords

Digital Art, media art, installation, Semantic affordance, digital brittleness, surveil- lance society, derive, geo-location, web technologies, visualisation

2 Introduction

The pervasive nature of surveillance, and the normalisation of the signs of it – both physical and metaphorical, is arresting when it is laid out how clearly intertwined this silent over-watch of endless surveillance cameras has become with our everyday lives. Across Europe and the wider globe, surveillance of the body public, of civic space, of every interaction in everyday society appears at some kind of saturation point. 1 In 2015 the then UK Information Commissioner, Tony Porter, himself a former Counter-Terrorism officer said

’The lack of public awareness about the nature of surveillance troubles me’
and as Matthew Thomas wrote in the Guardian newspaper, quoting Porter;

[it] risks changing the ”psyche of the community” by reducing individuals to trackable numbers in a database

[25] This is despite strong evidence that the publicly stated goals of civic safety and crime prevention are not being fulfilled. The 2005 UK Government Home Office Research, Development and Statistics Directorate concludes in its official report, ’Assessing the Impact of CCTV’ [14] that the CCTV schemes that have been assessed had little overall effect on crime levels […] CCTV is an ineffective tool if the aim is to reduce overall crime rates and make people feel safer. The CCTV systems installed in 14 areas mostly failed to reduce crime (with a single exception), mostly failed to allay public fear of crime (with three exceptions) and the vast majority of specific aims set for the various CCTV schemes were not achieved.

In 2004 Richard Thomas the then UK Government Information Commissioner warned [2]

My anxiety is that we don’t sleepwalk into a surveillance society where much more information is collected about people, accessible to far more people shared across many more boundaries, than British society would feel comfortable with

Making a comparison to the collection of vast quantities of information on individual of Franco’s fascist state and the eastern European communist regimes, he added in response to the question of whether there was a risk of Britain following this route,

I think there is a danger. I don’t think people have woken up to what lies behind this. It enables the government … to build up quite a comprehensive picture about many of your activities.

1 In its 2013 report, The Picture Is Not Clear: How Many CCTV Surveillance Cameras Are There in the UK?, [3] the British Security Industry Association (BSIA) suggested that camera numbers in the private sector could outnumber those used by public bodies by as much as 70 to 1. The BSIA survey covered the whole of the UK, not just London, and its maximum estimate suggested there was a CCTV camera for every 11 people in the country though it said the most likely figure was closer to one for every 14 people.

It is against this confusing and disturbing backdrop that this project asks a question of the surveillance colonisation of the physical environment around us by building, visualising and exploring an international database of signs of surveillance. These seemingly ubiquitous information/warning displays come in all shapes, sizes and designs and whilst often appearing helpful or informative are actually (in the UK at least) part of the legal obligation, largely unknown by the public and ignored by operators, on any operator or installer of a CCTV surveillance camera. The Information Commissioners Office (ICO), the independent UK authority, explains in the guidance ’CCTV filming carried out by others: What can I expect?’ [23]

The CCTV operator must let people know they are using CCTV. Signs are the most usual way of doing this. The signs must be clearly visible and readable, and should include the details of the organisation operating the system if not obvious. (emphasis added)

CCTV should only be used in exceptional circumstances in areas where you normally expect privacy – such as in changing rooms or toilets, and should only be used to deal with very serious concerns. The operator should make extra effort to ensure that you are aware that cameras are in use.

As can be seen from the corpus of collected images in this project, this point that CCTV warning signs ’should include the details of the organisation operating the system’ is one that is notable when operator information is included rather than when it is absent, such is the apparently casual attitude to the use of CCTV and any adherence to privacy or regulatory policy.

This growth of surveillance and reactions to it, rather than being a recent phenomenon, has been going on for nearly three decades. Several artists and projects have worked in this area, notable amongst them are recent projects such as ’Art and Surveillance’ lead by Susan Cahill in Canada that collates artistic projects on surveillance [8] and older ones such as http://www.spotthecam.nl created in early 2000’s by Maurice Wessling and Bits of Freedom ¹⁾https://www.bitsoffreedom.nl in conjunction with the Waag Society in Amsterdam, Netherlands ²⁾ https://waag.org and the ’Surveillance Camera Theatre’ ³⁾ http://www.notbored.org/scp-how-to.htmlfrom the Surveillance Camera Players, [24] an informal activist theatre troupe formed in 1996 in New York City between Bill Brown and Michael Carter. Carter, in his 1995 manifesto ’The Guerrilla Programming of Video Surveillance Equipment’ [9]proclaims;

It is important to remind oneself of the relationship between the eye of the media and that of the corporate police state – for they are both the guardian of the commodity, however nebulous and ephemeral that commodity may become. As a tactic designed to point out the paradox of a system that turns the lens on a public that has been taught to place more importance on images recorded by cameras than images seen by their own eyes, we propose Guerilla Programming of Video Surveillance Equipment (emphasis added).

As a photographic observational project the existing corpus of images of ’signs of surveillance’ comprises over 2000 digital photographs taken across the globe between 2015-2019. Each image contains date, time and geo-location meta-data allowing geographic mapping and search and retrieval in a variety of ways. The whole project has several elements;

• A compendium of the designs, locations and forms of the myriad of sign-types in the collection (see figure 1)
• A traditional digital photographic print exhibition
• An interactive 3D geo-map based visualisation (see figure 6)
• An online web based searchable catalogue that asks for public contribution to extend and complete the European map of Signs of Surveillance
• Training a Machine Learning system on the corpus of signs to enable automatic sign recognition

.

This chapter deals with the development of element number three, the development of an interactive, dynamic 3D geo-map based visualisation of the photographic collection.

3 Process of gathering raw images and meta-data

The process of gathering raw images for the collection of photographs of signs of surveillance began as a non-verbal act of noticing, in noticing the apparent over-abundance of these signs in public spaces. After noticing came the wordless desire to evidence that noticing, to collate and compare, to contrast and reflect. To investigate if the feelings of noticing were borne out by actual evidence, in this instance the evidence being the collation of photographs recording the signs. This process of observation and recording as basic research, and raw material, is common to many artistic practices, and is a recurring theme I use to undertake non-verbal investigation of items of importance I see in the world around me. In some ways I use the camera as one would a microphone to take field recordings for later study in the studio. In this work the gathering of images made the proliferation of these signs in public spaces abundantly clear. Partly as the act of looking for them became habit, partly as my subconscious eye became trained to see these small icons, images and visual devices and the kind of places they would appear. High up on walls of large buildings, low down on shop doorways, in the entrances and lobbies of offices and houses. The act of looking also revealed the signs in unexpected places, amongst piles of pastries in display cabinets, buried in hedges and flower beds in residential gardens, on the sides of cars, buses, trams and trains, and on vending machines and garden sheds.

3.1 Building semantic affordance with artistic raw materials

In the process of gathering the photographs, extending the corpus of images from country to country as I travelled whilst engaged in work on other projects, a feel for the body of work began to emerge. The feeling of emergent, artistic, comprehension is one that I recognise when undertaking works of almost any sort. From extended drawing studies of scenes or objects to wrestling with the philosophical aspects of how best to structure a system when incorporating dense computer code (such as the Volca project [6] [7] or the Time Machine [5] [4]. This understanding is the developing of a cognitive, sensory and implicitly non-verbal relationship with the materials and ideas or objects under scrutiny. It is a feeling of what I call ’semantic affordance, in that one feels an innate ability to cognitively manipulate the essential conceptual elements embodied by whatever is the subject of scrutiny. This affordance gives a direct fluidity and competence that allows further examination and contemplation of the materials at hand at a conceptual and ontological level. This affordance or agency to manipulate the conceptual elements embodied by the material under study could be seen as the central activity in my artistic practice. It is through this level of deep non-verbal understanding of the manifold semantic concepts seen held within objects and materials that informs the aesthetic choices that are made when re-formulating materials in the preparation and creation of artistic outputs. As the artistic outputs are imagined, sketched, produced as maquettes, and prototypes, a re-connection to the original non-verbal enquiry is sought. The process is a search to close the loop from initial observation, non-verbal comprehension, manipulation and synthesis of conceptual structures to a final embodiment of concepts as an intervention into the physical world. The answering of the initial question, the final scratching if a mental itch. IN this sense the works are predominantly conceptually driven and operate at a physical level in the conceptual rather than technical or decorative world. As Shanken [21] raises in Art in the Information Age: Technology and Conceptual Art’, although the divisions between conceptual art and technological art have generally been seen as in conflict he explores the view that whilst the history of technological art has been seen as separated from that of conceptual art both were rooted in experimentation and re-interpretation and proposes a rethinking of their status as separate and divorced from each other. He quotes Sol Lewitt’s 1967 [16] essay ’Paragraphs of Conceptual Art’ where Lewitt describes conceptual art as a quasi-mechanical process.

In conceptual art the idea of concept is the most important aspect of the work . . . [t]he idea becomes a machine that makes the art.

It is this very idea that drives my quest for these conceptual affordances in the work, that allows mental structures to be created from which the art creates itself. The arena of the technical in part is a desire to work unbounded by both convention and the patina of the physical that seem part and parcel of other mediums of expression. The ’active’ nature of technology allows for embedding, encoding and subsequently animating these ’conceptual machines to make art’ into the systems underlying the physical surface of the work.

3.2 Gathering images and the De ́rive

In this project the initial activity was a process of subconscious harvesting, conducted as an ongoing photographic de ́rive, a drift, though the world we inhabit with a watch for these signs of surveillance, that had now become artistic items of interest. Guy Debord, French philosopher and author of ’The Society of the Spectacle’ often associated with Situationist International ⁴⁾https://www.tate.org.uk/art/art-terms/s/situationist-international, describes the de ́rive as;

a mode of experimental behavior linked to the conditions of urban society: a technique of rapid passage through varied ambiances

[13] Over the period beginning with the first photograph of the series, taking in Lisbon in June 2015, and lasting through fifteen countries and more than four years over 2,000 images of signs of surveillance were recorded in de ́rive fashion.

4 Managing and manipulating large digital image corpuses as artistic raw material

Dealing with materials gathered using digital tools as the subject of artistic study has a number of opportunities and also challenges. Some of these are common to the practice of much artistic research and some unique to digital materials. Digital materials, whilst fluid, flexible, malleable, and almost instantaneously duplicable and transferable are also at their core, inherently brittle. Their flexible, immaterial, nature and their ability to be versioned, transcoded, summarised and edited means that any notion of an original is fleeting and slippery. Attempting to trace the origin, and original of a digital document is like grasping at a ribbon blowing in the wind. Partly this is the nature of sampling the world with digital, ie; numerical processes. It is important to remember that the sampling process is fundamentally divorced from techniques of the analogue recording realm. ⁵⁾Sampling puts a mesh to the world and encodes numerically, explicitly sampling reality at positions on a pre-defined grid – the only parameters of this crude and bombastic approximation are the frequency and resolution of the grid and the depth of the data captured or sampled at each point. All information, texture and nuance between the sampling points of the grid is simply ignored or disposed of The connection with the place and instant of creation is fleeting, and beyond the memory of the place and time that a button was pressed or a menu-item clicked the digital object has no patina or evidence of its place or moment of creation.

Aside from its meta-data.

4.1 Meta Data and artistic data management

All digital artefacts have meta-data, that is, there is data about the data. There is information about the information contained inside any digital document, be it sound file, image, text, video or software code. What is unusual is that in the digital realm this meta data is built of the same substance as the mate ́riale it describes. In the instance of this project each image was recorded with meta-data describing the image. There are basics facts associated with any digital files, eg. creation date, modification date, byte size of the file, name, filetype and the current location of a document in a specific computer system. There also commonly exists within image files additional data using the EXIF (EXchangeable Image File format) standard ⁶⁾https://www.exif.org. The EXIF data standard was originally introduced by the The Japan Electronic Industries Development Association (JEIDA) in 1998 and is widely adopted as a standard to store extended information about digital photographs. This meta-data commonly includes information about the make and model of the apparatus or camera used for the original recording and extends to information about lenses, flash, aperture and shutter speed of the recorded image. The meta-data also includes contextual or circumstantial data including the date/time of the image capture and increasingly common with images taken with smart phones and the latest generation of hand-held cameras, the geographic meta data, expressed as latitude, longitude and altitude. This EXIF data and specifically the associated geo-location data became of particular interest in the course of this project and is processed and manipulated heavily in the final artworks produced as part of the work.

5 Developing artworks combining hand-coded and industrial digital tools

Developing artworks utilising technology, whether that be industrially mass-produced physical materials such as paint, canvas, glass-fibre, electronics or software involves a level of compromise and negotiation with the materials an artist chooses to engage with. Being restricted to colours manufactured by a supplier, being constrained by the retail costs of a device or being challenged by the features available in a software API are all within the same canon of challenges faced by artists working in many contemporary contexts. As an artist regularly working in depth with technology, and software specifically, this challenge of adapting, working with, fighting with and customising industrial products is a regular occurrence. Part of the aesthetic of much technology orientated art is this engagement with, and subversion of, industrial products. Situating them in new contexts and utilising them in new and novel ways. Implicitly tied to this aspirational goal of both mastery and subversion comes a challenge within the practice of making art with technology, one that is endemic to all art but is amplified exponentially when engaging with software. This challenge is the negotiation, both in production and distribution of works, with the inherent brittleness of digital things

5.1 On the brittleness of digital things

As all physical things decay and change under what appears to be the effect of time, 8 so do digital ones, and this decay is seemingly at a rate inversely proportional to the power of digital material. Just as a digital image can be spread around the world and seen and manipulated by a billion people simultaneously it can also collapse, cease and disappear with equal speed. A server outage, a power failure, a change in a software API (Application Programming Interface) 9 or even the simple act of applying a seemingly unrelated operating system update can bring digital artworks, not to their knees, but to a state of ceasing to be. Though digital files and lines of software code may still be intact, software art, like video art before it, is performative and temporal, it exists at the moment of viewing, it needs to be run, to execute, to function, to fullfill it’s promise as art. This base need to instantaneous creation, to generate itself at the moment of viewing by an observer, is the challenge, excitement and weakness at the heart of digital artworks. Bit Rot, [15][10] or occasionally Link Rot 10 is described by Coupland in his 2016 book of the same name [12] as

the way digital files of any sort spontaneously (and quickly) decompose

8 One could begin a lengthy discussion in the nature of the perception of time, correlation and causality. Suffice to say that in most practical and functional aspects it would appear that as Stap- pers and Giarcardi point out in their work on Designing for temporal context; [22]

The most important thing designers should know is that there is no such single thing as time

As Carl Sagan says ”[Time] is profoundly resistant to simple definition.” Discussing the nature of time, Sagan, in an interview during the making of NOVAs TV program ’Time Travel’, goes on to note [20]

’Ever since St. Augustine, people have wrestled with this, and there are all sorts of things it isn’t. It isn’t a flow of something, because what does it flow past? We use time to measure flow. How could we use time to measure time?’

9 ’In computer programming, an application programming interface (API) is a set of subroutine definitions, communication protocols, and tools for building software. In general terms, it is a set of clearly defined methods of communication among various components. A good API makes it easier to develop a computer program by providing all the building blocks, which are then put together by the programmer. An API may be for a web-based system, operating system, database system, computer hardware, or software library. An API specification can take many forms, but often includes specifications for routines, data structures, object classes, variables, or remote calls. POSIX, Windows API and ASPI are examples of different forms of APIs. Documentation for the API usually is provided to facilitate usage and implementation.’ (https://en.wikipedia.org/wiki/Application programming interface)

10 https://www.techopedia.com/definition/20414/link-rot

and is ’a slang term for hypertext links that are broken. Link rot is created when a Web page is moved, taken down or reorganized. Clicking on a rotten link usually results in a 404 error, which includes a message that the page cannot be found.’ This ’digital decay’ affects all computational systems and is in equal parts the ventral thrill and motivation and also an ever-present challenge in digital art making. As the internet pioneer Vinton Cerf observes [10]

There is something ultimately satisfying about keeping information in digital form… But this blissful outlook may not comport with the reality of digital information preservation and interpretation.

In the context of this artwork I am writing about – sat in seat 6c on a flight to Lisbon, tapping on a tablet computer (and now weeks later re-editing on a subway train under Hong Kong harbour) – hoping that what I write here will synchronise flawlessly with the master version for this document so I can continue on my laptop at home, or the desktop computer in my office or the myriad of other computers I have in my two studios – the challenge of working with industrial tools in the making of signs of surveillance has been great. Both in the practicality of the making of the work, designing, programming and forming it, but also in the conceptualisation of it, the philosophical and aesthetic decisions underpinning it structurally. This arena is the ill defined and rarely talked about area where semantics and ontology meet engineering. Where philosophy becomes embodied in systems and structures and ways of doing things. Just as William Gibson says [1] with incisive clarity

We can’t see our culture very well, because we see with it

Perhaps this sentiment is distilled to it’s essence in the Japanese anecdote that ’to a hammer, everything looks like a nail.

5.2 Aesthetics, frameworks, APIs and ontologies

When looking through the gathered body of work, mentallly sitting amongst the thousands of photographs from around the world, and reflecting on the journey of collection and understanding, a non-verbal set of connections start to be made, there begins to form an ontological framework of what is and what is not, what does go and what does not when considering, comparing, organising and arranging the material. Alongside the challenges in managing digital collections, of cataloguing, versioning, trans-coding, naming, renaming and duplicating and archiving there is the selection of applicable tools to manipulate these non-physical collections of things-that-may-be.

In the development of the work the public exposure of the meta-data inside each image became increasingly important in relating an individual item in the collection to the whole. Beginning with a process of drawing, commonly with ink on paper, ideas of collating, relating and visualising this relationship, between individual element and the whole, took shape. Sketching ideas in code, using the C++ toolkit,

openFrameworks 11, a sense of the dynamic in the material came to the fore. Initially the project was an observation and de ́rive exercise and at a certain stage it transformed into a discussion with the gathered material. As is of often the case in life drawing, one starts with mark making in reference to the subject being observed but at some point crosses into mark making in reference to the body of marks one has made on the paper or canvas. Adding to or subtracting from a growing object that begins to exist independently of that which is originally observed. This is the point where a piece of work develops its own life or emergent identity, one that is divorced from being a facsimile of the original scene.

After working with initial crude mappings of the geo-located images into 3D space using geometric primitives and texture mapping of a variety of representations of the earths surface a move to a more complex visualisation was needed. To access high-resolution maps and images of the surface of the whole earth necessitated engaging with external data sources. Initially continuing working writing code in C++, the open-source online OpenStreetMap (OSM) 12 GIS (Geographical Information System) database was accessed through it’s web based API. 13 Whilst this brought huge flexibility and access to a wealth of visual and meta-data about the earth it added a subtle but pivotal disjuncture in the work. Even though the code was still hand written C++, compiled to run locally as an executable binary application on a specific machine, the work now had a brittle chain of failure built into it. The work now became reliant on an internet connection, reliant upon a connection of sufficient bandwidth to the outside world and at the other end of a chain of routers and connections. It was reliant upon the servers at OSM being available, and that the access restrictions, and protocols of their API, and the data in their underlying database were available and had not been altered, patched, upgraded or had their license of use changed. What also began to happen is that the underlying ontology, the causal philosophy of the interrelation between elements, images, ideas and concepts that was embodied in the architecture of the software I was writing changed. The attitude and values In the project, the structure, classifications and ontology that was emerging, was codified in its most concrete form in the classes, methods, functions, loops, arrays, iterators and variables that scaffolded and guided the work to become at the moment of performance. By engaging with this external API, and the underlying philosophy, attitude, ontology and expectation encoded within it, it there began and evolving and protracted negotiation on how to navigate the external conceptual space without becoming overwhelmed hegemonistically 14 and becoming merely an extension of it. Illustrating what it could do, rather than a master of it demonstrating what I could do with it, sculpting it to my will and the will of the evolving work.

11 ’openFrameworks is an open source C++ toolkit designed to assist the creative process by providing a simple and intuitive framework for experimentation’ (https://openframeworks.cc/about/) 12 http://www.openstreetmap.org
13 Utilising the openFrameworks add-on ofxMaps (https://github.com/bakercp/ofxMaps). ofxMaps creates an interface to OSM in the ’SlippyMap’ style (https://wiki.openstreetmap.org/wiki/Slippy Map). It is written and maintained by Christopher Baker

14 The Encyclopedia Britannica describes Hegemony as the dominance of one group over another, often supported by legitimating norms and ideas. The term hegemony is today often used as shorthand to describe the relatively dominant

This conundrum is somewhere between the Sapir-Worf hypothesis [17] on how language shapes thought and conceptions of one’s reality and the ominous words of Friedrich Nietzsche when he said. [18]

Whoever fights monsters should see to it that in the process he does not become a monster. And if you gaze long enough into an abyss, the abyss will gaze back into you.

This negotiation for control became a battle, metaphorically, for the ground under the project, this external empire of protocols and ontologies and the emerging artwork – using C++ but communicating into a web based world, using http transport 15 layers, began to shape, not only what was being said but a shift linguistically into the world of web technologies. That is not to say that the possibility to stay in the dialect I was writing in was not available, it was entirely, but the challenge would be to re-write for myself the additional tools, utilities, libraries and processes I was beginning to rely on to achieve the realisation of my increasingly complex and specific pen and ink drawings of the project. Just as a decision to make your own paint becomes a significant part of the work so does the decision to make ones own digital tools.

As Richardson discussed in his 1998 article ’New Media , New Craft’ [19] reflecting on what the status of new digital tools may be in an art context,

Using programming to create a piece of art or design requires an abstraction of thinking, translating the idea of the final visual form into a structure required to create the work. A leap of understanding is required to translate a creative idea into a piece of code. Creative ideas and solutions are thus abstracted into structures and objects that are natural to the computer material. Such an understanding of material subsequently creates work that echoes the invisible structure of the code

Richardson goes on to add

The use of programming, as a way of manipulating and understanding the new material, also represents the means by which artists and designers are able to get closest to the virtual material. When they use programming to create a visual work, the underlying process and structure become of fundamental importance. The invisible structure of the work becomes as significant as the final outcome. The work experienced by the viewer is a visual translation of the underlying framework and mental engagement of the artist or designer with the material.

This challenge, between using available tools, and travelling further, faster and making everything from scratch for oneself, perhaps risking re-inventing the wheel, having taken years to learn how to best make a wheel, is common to many artistic endeavours but never more so than in self-coding digital artworks. Richardson continues pointing out the difference that hand-crafted digital tools make in the conceptual understanding of any artwork

position of a particular set of ideas and their associated tendency to become commonsensical and intuitive, thereby inhibiting the dissemination or even the articulation of alternative ideas. The associated term hegemon is used to identify the actor, group, class, or state that exercises hegemonic power or that is responsible for the dissemination of hegemonic ideas.

(https://www.britannica.com/topic/hegemony)
15 http, or hypertext transport protocol, is a computer protocol that is used to allow clients (commonly web browsers running on users computers to request and subsequently receive text, image, audio and video data from web servers)

In direct contrast to the post-modern point-and-click, cut-and-paste approach to creating a piece of creative work, the use of programming requires that a framework is firmly established, around which the work is built.

Having made strategic choices and seen where the project wanted to go, and how it could be formed in a way that allowed it to talk for itself investigations of middleware frameworks and software libraries began in earnest. Moving parts of the codebase into java script and using the browser as interpreter and platform rather than the byte code produced by CLANG or the GCC C++ compiler allowed easy integration with online utilities I was already using. Such as map-tiles 16 of satellite and geopolitical imagery and reverse geocoding 17 This easy ability to communicate with remote functions, features and data comes with an additional cost beyond the loss of independence, self reliance and overall stability. In this instance it carried a commercial one. Although I was using a free developer account for one of the major mapping utility providers the monthly usage limit was quickly reached for data requests. Due to license limitations on usage of the data that was provided it was not legally possible to cache data between sessions of usage, nor store it in any long term or permanent way. This necessitated performing a reverse geo code look up for the locations of images each time the project was viewed or run. Necessitating over 2000 calls to the remote API each time. Although the cost of an individual reverse geocode request was only fractions of a cent per request this added up to a cost of USD2 Every time the work was viewed. The map-tile imagery requests came in addition to this cost. Looking at open source alternatives became complex, whilst the service cost was free and the license terms far less restrictive the data servers were not configured for heavy use. Resulting in the servers banning the IP address of the requesting machine after the first few hundred geocode requests. A strategy was developed to pre-request and cache the geocode data and serve it from a self-hosted server by writing a script that requested the relevant information from the open source server at a deliberately slow, throttled rate and writing the returned reverse lookup data to a local file in geoJSON format. 18 This conformed with both the terms of use of the open source server and also its license on use and retention of data. The second challenge was on how to deal with the mapping data being requested from the commercial provider. Open source map data providers, understandably, were unable to supply maps data in the quantities the project needed and also separated the idea of individual users of the service from the creation of applications that would use the service. Unfortunately there appears very few instances of a middle ground for artistic or non-profit uses of open source services putting most artworks or projects that use 3rd party services or data firmly into this arena of being classed as commercial users and being charged accordingly.

16 map-tiles are a way of breaking large GIS orientated datasets such as maps into smaller fragments that can be called and used as needed, remedying the need to load large data sets as mono- lithic pieces. A calculation is made of the geo-location that is of interest, the scale that the map is to be viewed and the size of the viewing port (or in our instance, web browser window) a series of request are made the the map-tile server and the corresponding map fragments are returned as individual files and then tessellated in the viewer

17 Reverse geoCoding is the ability to take and specific geo-location, commonly expressed in latitude and longitude, and return a descriptive physical world location. For example the a reverse GeoCode request for the location 52.356991666666666, 1.2931251573910854 is returned as ”Oostpoort 12, Waldenlaan, Winkelcentrum Oostpoort, Amsterdam, North Holland, Netherlands, 1093NH, Netherlands by the OpenStreetMap database ) functions that allowed the work to turn the GPS latitude and longitude data inside individual images into named localities with street town and country data.

One of the options available within the license terms for the core corpus of map image data – the smaller version being in the region of 65gb of image tiles – was to clone the data needed and set up and operate a web based map-data server specifically for the project . This added a layer of technical complexity and a certain amount of unnecessary redundancy but afforded a break from the reliance on commercial providers and also added the possibility of generating a machine specific version that could run as a single instance of the project with all necessary data held locally. This would remove the requirement for an internet connection for a greater level of autonomy. This involves setting part of the host computer to operate as a web server and routing web calls from the work or application back to the locally running web server, sometimes called LocalHost’

With these two elements in hand, batch generated reverse geocode data, locally held, and provisioning the projects own map data server, the forming, tuning and final choreography of this section the piece proceeded

6 The challenge of live vs video. Of activity or interactivity. Of exposing the internal or relying on the surface

In developing live digital works there is a challenge of exposing and communicating where the work is. In the case of paint and photography and other flat visual arts the work is commonly readily identified in the surface. When working with live digital processes this identification, location and exposition of the work – in this case meaning the artistic effort, intention or focus of attention – becomes obfuscated and requires specialist technical knowledge to gain insight into often hidden black-box processes. Some artists working with digital / technological processes take the route of exposing the mechanism of systems, disassembling computers into their working component and exhibiting them exploded on gallery floors, deliberately exposing the ’technology’ to indicate complexity and ’liveness’. Another common route to provide this exposition to an audience is to make systems interactive or reactive to some aspect of the audience. Making clear that something live and dynamic is occurring and perhaps leading the audience into considering that which is beneath the surface, the ’deeper mechanic’ inside a work or piece. With work that takes neither of these routes, work that is active but not interactive, that does not make its components part of the artwork display the challenge is to help the audience understand that what they see is live and note rendered video recordings or premade files being re-played. That each moment seen is created and becoming at that moment. It is being performed live, never to be repeated in that fact same way again.

18 GeoJSON is an implementation of JSON (JavaScript Object Notation) that encodes geographic information in text form as nested objects, typically containing a latitude and longitude geometry reference optionally followed by additional data. In our instance the data encoded includes details of the EXIF camera data relating to images and their recording location. A example typical GeoJSON entry will look similar to the following; ”geometry”: ”type”: ”Point”, ”coordinates”: [ 4.927913888888889, 52.356991666666666, 1.2931251573910854 ] ”type”: ”Feature”, ”properties”: ”url”: ”sign6.jpg”, ”date”: ”2018:04:30 10:07:09”, ”orienta- tion”: 6, ”make”: ”Apple”, ”model”: ”iPhone SE”, ”size”: 23397, ”type”: ”image/jpeg”, ”locality”: ”Oostpoort 12, Waldenlaan, Winkelcentrum Oostpoort, Amsterdam, North Holland, Netherlands, 1093NH, Netherlands” , )

6.1 Exposing the internal or relying on the surface

This challenge of exposing the internal mechanism of projects and works and the delicate balance of the work end up being about the mechanism and the tools rather than the original intent is a complex one. In this work the multi-part nature of the outputs from the project allows a range of expression and nuance that is another work would not necessarily be available. With the installation version of Signs of Surveillance the clean collection nature of the Photographic source material and the exposure and manipulation of the image meta data is clue enough to the live/process nature behind the work. Alternative versions, such as the artists book and the controllable web based version address other elements of the project sufficiently

6.2 The final work for gallery installation

The final instantiation of the work discussed in this article is designed for viewing in a gallery or installation context, and has been tuned, sculpted and shaped accordingly. In an installation context the audience is mixed, with a range of interests, awareness, and contenxtual insight. The audience, the viewer also has a range of available temporal modes within which to receive the work and the underlying themes and idea. Part of the work is paced and presented for for a transitory audience with short attention and an availability of meaning in the surface of the work that is ’glanceable’. That will survive artistic scrutiny of a glance of a few seconds. At another level the work has a deeper pace and rhythm that is designed to survive deeper scrutiny and draw the viewer into a deeper dialog with and understanding of the work. Allowing nuance and interpretation at the pace and depth the viewer is comfortable with. The work for gallery installation is active but unlike it’s open web based counterpart (available publicly at http://signsofsurveillance.com) not explicitly interactive. To this end it has a specific set of behaviours that it exhibits to engage the viewer and draw them through the corpus of work. When working through the meta-data accompanying the body of images a certain irony was revealed, in that, if one followed the time-stamps of the collected images one could re-create, with a varying range of accuracy, the route that I had taken through neighbourhoods, cities and countries around the world over the preceding five years. The time-stamp data combined with the geo-location of each image showed the points on the globe that I had stood at the press of every shutter and the capture of each photo- graph. Beginning to investigate these invisible lines, simple routines were written to create a single path through each geo-point. Using both Catmull-Rom 19 and Be ́zier 20 curves different paths were visualised showing the path between each captured image (see figure 3)

7 Conclusion

In this chapter I have attempted to expose and discuss some of the approaches and practices that I have evolved and adopted over the last 30+ years of working with digital technologies. My original thoughts were that working in conjunction with complex, highly sophisticated tools and systems transformed the relationship from one of artist and tool into much more of an intimate discussion, a collaboration. Where one asked questions of the systems one engages in, navigating and negotiating the parameters and avenues in and through the conceptual structures, functions and processes inside the machine. From this comes the innate understanding of the systems and materials one is working with, what I have called semantic affordances. Sadly this conceptual flexibility and strength that digital materials bring also brings multiple points of failure, usually with no graceful decline, a point of failure at any juncture in a digital artwork is usually complete failure. This is what I mean when I talk of the brittleness of digital things. For this work, that is extensively involved with the collection of a large body of individual items working in the digital gives great flexibility to collate, manipulate, transform and express. It also gives myriad opportunities for instantiation of a work in the physical world, and huge availability of choices of how to make an intervention into the mind of the viewer. in this instance the challenge came in making gallery orientated versions and web based whilst using web technologies and remote data in both. The issue of reliance on, and of cost, when using external systems, such as map-tile data and geo-location services was a particular challenge but let to new and interesting areas setting up self hosted and local versions of some of these external commercial data sources.

19 A Catmull–Rom spline, named for Edwin Catmull and Raphael Rom, is a special case of a cardinal spline. Catmull–Rom splines are frequently used to get smooth transitions between key points and are often used in animation and similar Computer Graphic works
20 Named after Pierre Be ́zier, a Be ́zier curve is a parametric curve used in computer graphics. Several points using Be ́zier curves can be combined to form a Be ́zier spline

This does however have its own drawbacks, the writing discusses in some detail the philosophical, cultural and ultimately ontological struggle when engaging with external systems, APIs and data. That they have their own political approach, their own ontologies and that can be a hegemonist force with the potential to overwhelm the internal ontology that an individual work of art generates for itself. This question of the internal complexity and dialog that goes on inside active digital works is the last point in this writing, investigating some of the challenges that are balanced when dealing with the decision of how much to expose the internal structures of a work to bring viewers deeper inside, drawing them below the surface of a work whilst not making the work purely about the internal structure. Working to retain the original focus of the work but helping give insight into the live process at work at the moment of performance, particularly with works with any generative nature to them.

7.1 Final reflection

The final version of this work, or at least the current version, is part of a body of pieces that are differing expressions of a formalised process of collecting and collating. This collecting began as a de ́rive of observation and photographic collecting around the world. Begun initially as a completely non-verbal process the project developed its own vocabulary and logic over the years of photographing, to the point where the material began to guide the form and the final work. Only then began the process of exploration in the studio, of applying technological processes to illustrate and instantiate the mood developing inside of the work. This process is common to much of my work and my day to day artistic activity. One that is an ongoing dialog I have with the world, of observing, looking, making, and underneath its all ultimately seeking sense-making.

the work, while not forcing a specific political point, is intimately political. It is intended as an exposure of pervasive surveillance of our physical world. To a scale that continues to surprise me, even as I become inured to it. This journey we have chosen to take with surveillance technology, and the ability we have built to track, record and intrude into every aspect of the body public, and our individual bodies, private is operating at a scale that many would find unimaginable should they be able to see it clearly.

As Noam Chomsky, never one to use an alarming phrase when calm reasoned words will do, says [11];

there are two things to bear in mind, one is that the phenomenon (of surveillance) should not be at all surprising, the second is that the scale of it is surprising

8 Epitaph for a digital artwork

I sit and write, longhand on paper with a pen, the epitaph at the closing of this chapter. The document and journey written covering six countries, countless hours and edits, full of insight and reflection. The final edits are yet to be done but what I can write now is the epitaph. reading back through this writing I find I have made a fuller, more complete explanation of my internal process, discussion and artistic activity than ever before in one place. At times technical, philosophical and political I trust the reader will forgive me streams of consciousness and occasional melodrama of the miniscule internal theatre that is the struggle of working with digital tools. This writing, alongside ongoing development, coding and versioning of the software has given me space to reflect on process and practice with a fresh perspective. Thinking of the work, in progress for nearly half a decade, makes me reflect that most readers of this will never see it. That by the time this volume is typeset, proofed, approved, printed and distributed, the work may, in practical terms, cease to exist. Web domains I pay for will expire. Servers will be upgraded, patched, obsoleted and retired and I will go on to new projects, works, technology and software. In very real terms this chapter of ink-on-paper (or the undoubtedly shorter lived pixels-on-screen) will outlast the work by a magnitude of scale. Sitting in Hong Kong in late June 2019 the mood is sombre but resolved and the world seems fragile and tenuous. This work on Signs of Surveillance is a small postcard in a discussion of technological change, reflecting on the fundamental importance of the ephemerality of art, of the importance of its functionless-ness. On the innate lack of practicality that those versions and instantiations of it that require upkeep, maintenance and care to continue to exist are happily always consigned to memory. This is the epitaph to a work of art that will soon cease to be. That will fail by nature of its powerful but short lived reach and the fickle brittleness of the substance of which it is formed and the un-real substrate on which it is built.

As Picasso, Paul Vale ́ry or Da Vinci may have said, 21

Art is never finished, it is only ever abandoned.

and the abandonment of digital works into a continually changing virtual world affords them a very short lifespan when left to fend for themselves.

21.There is debate about the correct attribution to the quote, including paraphrasing W. H. Auden in Collected Poems 1965, ”Poetry is never finished; it is only abandoned.”

References

1. Beeker Northam: William Gibson, Interview (2015). URL https://medium.com/hand- brain/william-gibson-57e75f87e525
2. Booth, J.: UK ’sleepwalking into Stasi state’ (2004). URL https://www.theguardian.com/uk/2004/aug/16/britishidentity.freedomofinformation
3. British Security Industry Association: The Picture is Not Clear: How many CCTV surveil- lance cameras in the UK. Tech. Rep. 195, British Security Industry Association, Worces- ter, UK (2013). URL https://www.bsia.co.uk/publications/publications-search-results/195- the-picture-is-not-clear-how-many-cctv-surveillance-cameras-in-the-uk.aspx
4. Buzzo, D.: What Do We Know Of Time When All We Can Know For Real Is Now ? In: P. Reyes-Garcia E. Chatel-Innocenti, K. Zreik (eds.) Archiving and Questioning Immateriality: Proceedings of the 5th Computer Art Congress, pp. 438–443. Paris, France (2016)
5. Buzzo, D.: The Time Machine. In: C. Sena Caires, J. Cardosa, A. Lipovka, J. Bidarra, L. Pimentel (eds.) Proceedings of the 8th International Con- ference on Digital Arts – ARTECH2017, pp. 199–201. ACM Press, New York, New York, USA (2017). DOI 10.1145/3106548.3106617. URL https://dl.acm.org/citation.cfm?id=3106548picked=proxCFID=822909194CFTOKEN=38540610 http://dl.acm.org/citation.cfm?doid=3106548.3106617
6. Buzzo, D.: The Volca Project: A Multi-Sensory Camera for Augmented Reality. In: Conference on Human Factors in Computing Systems – Proceedings, CHI’18 Extended Abstracts,. ACM, Montreal, Canada (2018). DOI 10.1145/3170427.3177767. URL http://dx.doi.org/10.1145/3170427.3177767
7. Buzzo, D.: The Volca project: A sensory experiment in collaborative visualisation. In: Tran- simage 2018. The fifth International Conference on Transdisciplinary Imaging at the Intersec- tions of Art, Science and Culture. Edinburgh Futures Institute. The University of Edinburgh, Edinburgh, UK (2018). URL transimage2018.net/
8. Cahill, S.: The Art and Surveillance Project. URL http://www.artandsurveillance.com/about/
9. Carter, M.: Guerilla Programming of Video Surveillance Equipment (1995). URL http://www.notbored.org/gpvse.html
10. Cerf,V.G.:Avoiding”bitrot”:Long-termpreservationofdigitalinformation.In:Proceedings of the IEEE (2011). DOI 10.1109/JPROC.2011.2124190
11. Chomsky, N.: ”What is Anarchism?” Speech at MIT Wong Auditorium. November 18, 2013 (2013). URL https://www.youtube.com/watch?v=oB9rpSAp2U
12. Coupland, D.: Bit rot : short stories + essays. William Heinemann, London (2016)
13. Debord, G.: Theory of the De ́rive. Les Le`vres Nues #9. Les Le`vres Nues 9 (1956). URL http://en.wikipedia.org/wiki/Drive
14. Gill, M., Spriggs, A., Little, R., Spriggs, A., Allen, J., Argomaniz, J., Waples, S.: Assessing the impact of CCTV : the Hawkeye Case Study.
    Tech. rep., The Home Office, UK Government, London, UK (2005). URL https://webarchive.nationalarchives.gov.uk/20110218141419/http://rds.homeoffice.gov.uk/rds/pdfs05/rdsolr1205.pdf
15. Hayes, B.: Bit Rot. American Scientist (1998). DOI 10.1511/1998.5.410
16. Lewitt, S.: Paragraphs on Conceptual Art. In: Stiles, Selz (eds.) Theories and Documents of Con- temporary Art. University of California Press, Berkley (1996)
17. Lucy, J.A.: Sapir-Whorf Hypothesis. In: International Encyclopedia of Social & Behavioral Sciences, vol. 20, pp. 903–906 (2015). DOI 10.1016/B978-0-08-097086-8.52017-0. URL http://dx.doi.org/10.1016/B978-0-08-097086-8.52017-0
18. Nietzsche,F.:Nietzsche:BeyondGoodandEvil:PreludetoaPhilosophyoftheFuture(2002)
19. Richardson, A.: New Media , New Craft ? electronic art and animation calalogue pp. 157–159 (1998)
20. Sagan, C.: Carl Sagan Ponders Time Travel: Interview with Carl Sagan (1999). URL http://www.pbs.org/wgbh/nova/physics/Sagan-Time-Travel.html
21. Shanken, E.a.: Art in the Information Age: Technology and Conceptual Art. Leonardo 35(4), 433–438 (2002). DOI 10.1162/002409402760181259
22. Stappers, P.J., Giaccardi, E.: Time in the Expanding User Context of Designing. In: Proceedings of the SIGCHI conference on Human factors in computing. ACM – Association for Computing Machinery (2013)
23. The Information Commissioners Office: CCTV filming carried out by others. URL https://ico.org.uk/your-data-matters/cctv/
24. The Surveillance Camera Players: Surveillance Camera Players:10-Year Report (2006). URL http://www.notbored.org/10-year-report.html
25. Weaver, M.: UK public must wake up to risks of CCTV, says surveillance commissioner. The Guardian (2015). URL http://www.theguardian.com/world/2015/jan/06/tony-porter-surveillance- commissioner-risk-cctv-public-transparent