GREENING FACE: How Facial Expression is Made Sensible, from Pre-Christian Architectural Spaces to Post-Digital Smart Environments

Devon Schiller

Titles

Abstract

After the many algorithmic, computational, and digital turns over the last five decades, the ways in which we experience and understand the face as something in and of the environment appear to be fundamentally shifting. Indeed, today more and more corporations, institutions, and governments are using automated facial recognition systems within smart environments for abstracting data capital from facial behavior. Through a post-digital perspective, the author explores a history of ideas about the face in relation to its environment across the artistic, scientific and technologic imaginaries, both constants from the past and changes of the present. This intellectual historiography compares three sources: English folklorist Julia Somerset’s 1939 article “The ‘Green Man’ in Church Architecture,” German neurologist Joachim Bodamer’s 1947 case history “The Face Blind,” and Japanese computer scientist Takeo Kanade’s 1973 doctoral project “Computer Recognition of Human Faces,” as well as their rhizomatic interrelations. By tracing the role of the environment in the study of the face, the author maps a genealogical landscape of ideas that roams across the absence and presence of color, human perception and mediated vision, inner and outer ways of seeing, as well as nonvisible and visible imaging. And, to possibly reconcile the very real ambiguity of the human face with the digital binarism of our increasingly computational planet, the author proposes a “greening of the face” whereby the face and its environment are conceptually modelled as being concretized within a complementary, reciprocal process of becoming.

Keywords

biometrics, color theory, facial expression, facial recognition, Green Man, intellectual history, philosophy of science, physiognomy, psychology of art, smart environments

References

Anderson W., The Green Man: The Archetype of Our Oneness with the Earth, San Francisco: HarperCollins, 1990.

Araneo P.M., “Green Man Resurrected: An Examination of the Underlying Meanings and Messages of the Re-Emergence of the Ancient Image of the Green Man in Contemporary, Western, Visual Culture”, MA Thesis, University of the Sunshine Coast, 2006.

Balas B., Stevenson K., “Children’s Neural Response to Contrast-Negated Faces is Species-Speciﬁc”, Journal of Experimental Child Psychology 2014, vol. 119, pp. 73-86. DOI: 10.1016/j.jecp.2013.10.010.

Ballantyne M., Boyer R.S., Hines L., “Woody Bledsoe: His Life and Legacy”, AI Magazine 1996, vol. 17, no. 1, pp. 7-20. DOI: 10.1609/aimag.v17i1.1207. Basford K., The Green Man, Revised Edition, Suﬀolk: D.S. Brewer, 1998.

Belting H., Face and Mask: A Double History, transl. by T.S. Hansen, A.J. Hansen, Princeton, NJ: Princeton University Press, 2017. First published in Germany under the title Faces: Eine Geschichte des Gesichts, Munich: C.H. Beck, 2013.

Benitez-Quiroz C.F., Srinivasan R., Martinez A.M., “Facial Color Is an Eﬃcient Mechanism to Visually Transmit Emotion”, Proceedings of the National Academy of Sciences of the United States of America (PNAS) 2018, vol. 114, no. 14, pp. 3581-3586. DOI: 10.1073/ pnas.1716084115.

Bledsoe W.W., Chan H., “A Man-Machine Facial Recognition System—Some Preliminary Results”, Technical Report PRI 19A, Palo Alto, CA: Panoramic Research Inc., 1965.

Bledsoe W.W., “Man-Machine Facial Recognition: Report on a Large-Scale Experiment”, Technical Report PRI 22, Palo Alto, CA: Panoramic Research Inc., 1966. DOI: 10.1145/321328.321340.

Bledsoe W.W., “Some Results on Multicategory Pattern Recognition”, Journal of the Association for Computing Machinery 1966, vol. 13, no. 2, pp. 304-316.

Bleiker C., “Personalized Ads in the Real World”, DW News, posted 6 June 2017, https://www.dw.com/en/personalized-ads-in-the-real-world/a-39133518.

Bodamer J., “Die Prosop-Agnosie”, Archiv für Psychiatrie and Nervenkrankheiten 1947, no. 179, pp. 6-53.

Breadin S. (Creator and Administrator), “Green Men & Suchlike Curiosities: Seeking the Devil in the Detail”, Facebook Public Group, created 6 October 2016, https://www.facebook.com/groups/196857724077416/, accessed 1 June 2018.

Bruce V., Young A., In the Eye of the Beholder: The Science of Face Perception, Oxford: Oxford University Press, 1998.

Calbi M., Siri F., Heimann K., Barratt D., Gallese V., Kolesnikov A., Umiltá M.A., “How Context Inﬂuences the Interpretation of Facial Expressions: A Source Localization High-Density EEG Study on the ‘Kuleshov Eﬀect’”, Scientific Reports 2019, no. 9 (2107), pp. 1-16. DOI: 10.1038/s41598-018-37786-y.

Cave C.J.P., Roof Bosses in Medieval Churches: An Aspect of Gothic Sculpture, Cambridge: Cambridge University Press, 1948.

Centerwall B.S., “The Name of the Green Man”, Folklore 1997, no. 108, pp. 25-33. DOI:10.1080/0015587X.1997.9715933.

Chellappa R., Wilson Ch.L., Sirohey S., “Human and Machine Recognition of Faces: A Survey”, Proceedings of the IEEE 1995, vol. 83, no. 5, pp. 705-740. DOI: 10.1109/5.381842.

Child F.J., ed., “A Gest of Robyn Hode”, in: The English and Scottish Popular Ballads, Part V, Boston: Houghton Miﬄin, 1888, Internet Archive, http://www.archive.org/details/english-scottishp05chil.

Cohn J.F., Ekman P., “Measuring Facial Action”, in: The New Handbook of Methods in Non-verbal Behavior Research, ed. by J.A. Harrigan, R. Rosenthal, K.R. Sherer, Oxford & New York: Oxford University Press, 2008.

Connor N., “Chinese School UsesFacial Recognition to Monitor Student Attention in Class”, The Telegraph, posted 17 May 2018, https://www.telegraph.co.uk/news/2018/05/17/chinese-school-uses-facial-recognition-monitor-student-attention/.

Cook D.J., Das S.K., Smart Environments: Technology, Protocols, and Applications, Hoboken, NJ: Wiley, 2005, p. 3. See also: Z. Mahmood, ed., Guide to Ambient Intelligence in the IoT Environment: Principles, Technologies and Applications, Berlin: Springer, 2019.

Cramer F., “What Is ‘Post-Digital’?”, in: Postdigital Aesthetics: Art, Computation and Design, ed. by D.M. Berry, M. Dieter, Meadwille: Palgrave Macmillan, 2015, pp. 13, 19.

d’Orey Tiles, “Portuguese Azulejos”, business website, created in 2008, https://doreytiles.pt/wp/?lang=en, accessed 11 December 2018.

Darwin Ch., The Expression of the Emotions in Man and Animals (1872), New York: Penguin Books, 2009, p. 130.

DeLanda M., War in the Age of Intelligent Machines, New York: Zone Books, 1991.

Deleuze G., Guattari F., A Thousand Plateaus: Capitalism and Schizophrenia, transl. by B. Massumi, Minneapolis, MN: University of Minnesota Press, 1988.

Dupuis-Roy N., Soubeyrand S.F., Gosselin F., “Time Course of the Use of Chromatic and Achromatic Facial Information for Sex Categorization”, Vision Research 2018. DOI: 10.1016/hj.visres_2018_08_004.

Ekman P., “Facial Signs: Facts, Fantasies, and Possibilities”, in: Sight, Sound and Sense, ed. by T. Sebeok, Bloomington, IN: Indiana University Press, 1978.

Ellis H.D., Florence M., “Bodamer’s (1947) Paper on Prosopagnosia”, Cognitive Neuropsychology 1990, vol. 7, iss. 2, pp. 81-105. DOI: 10.1080/02643299008253437.

Farah M.J., Visual Agnosia, Second Edition, Cambridge, MA: MIT Press, 2004, p. 92.

Freiwald W.A., Tsao D.Y., “Functional Compartmentalization and Viewpoint Generalization within the Macaque Face-Processing System”, Science 2010, no. 330, pp. 845-851. DOI: 10.1126/science.1194908.

Freiwald W.A., Tsao D.Y., Livingstone M.S., “A Face Feature Space in the Macaque Temporal Lobe”, Nature Neuroscience 2009, no. 12, pp. 1187-1196. DOI: 10.1038/nn2363.

Gabrys J., Program Earth: Environmental Sensing Technologies and the Making of a Computational Planet, Minneapolis, MN: University of Minnesota Press, 2016, pp. 9, 324.

Gates K.A., Our Biometric Future: Facial Recognition Technology and the Culture of Surveillance, New York: New York University Press, 2011.

Goﬀman E., “On Face-Work: An Analysis of Ritual Elements in Social Interaction”, in: Interaction Ritual: Essays in Face-to-Face Behavior, ed. by E. Goﬀman, New York: Double day, 2005, pp. 5-45. Originally published 1967.

Hansen M.B.N., “Ubiquitous Sensation: Toward an Atmospheric, Collective, and Microtemporal Model of Media”, in: Throughout: Art and Culture Emerging with Ubiquitous Computing, ed. by U. Ekman, Cambridge & London, MIT Press, 2013, pp. 63-88.

Harding M., A Little Book of The Green Man, London: Aurum Press, 1998.

Harte J., The Green Man, Andover, MA: Pitkin Unuchrome, 2001.

Haxby J.V., Gobbini M.I., “Distributed Neural Systems for Face Perception”, in: Oxford Handbook of Face Perception, ed. by A.J. Calder, G. Rhodes, M.H. Johnson, J.V. Haxby, Oxford & New York: Oxford University Press, 2011, pp. 93-110.

Honnecourt V. de, Album de dessins et croquis, Paris: Bibliothéque nationale de France, 1225-1235, http://gallica.bnf.fr/ark:/12148/btv1b10509412z.r=villard%20de%20honnecourt.

Hopkinson K.A., Yeats S.M., Scott G.R., “For Whom the Coin Tolls: Green Stained Teeth and Jaws in Medieval and Post-Medieval Spanish Burials”, Dental Anthropology 2008, vol. 21, no. 1, pp. 12-17. DOI: 10.26575/daj.v21i1.97.

Illustrated London News, “No. 7, for the week ending Saturday, June 25, 1842”, in: The Illustrated London News, Vol. 1st from May 14 to December 31, 1842, London: William Little, 1843.

Irigaray L., Marder M., Through Vegetal Being: Two Philosophical Perspectives, New York: Columbia University Press, 2016.

Jarlier S., Grandjean D., Delplanque S., N’Diaye K., Cayeux I., Velazco M.I., Sanday D., Vuilleumier P., Scherer K.R., “Thermal Analysis of Facial Muscles Contractions”, IEEE Transactions on Aﬀective Computing 2011, vol. 2, no. 1, pp. 2-9. DOI: 10.1109/T-AFFC.2011.3.

Jenkins S., Wales: Churches, Houses, Castles, London: Allen Lane/Penguin Group, 2008.

Johnson A.D., Tarr M.J., “Red-Green, but Not Blue-Yellow, Color Manipulations Aﬀect Memory of Facial Identity”, Journal of Vision 2004, vol. 4, no. 8, p. 419. DOI:10.1167/4.8.419.

Jung C.G., Four Archetypes, ed. by S. Shamdasani, transl. by R.F.C. Hall, Princeton, NJ: Princeton University Press, 2010. Originally published 1959.

Kaliouby el R., “Driving Your Emotions: How Emotion AI Powers a Safer and More Personalized Car”, Aﬀectiva Blog, posted 5 January 2017, http://blog.aﬀectiva.com/driving-your-emotions-how-emotion-ai-powers-a-safer-and-more-personalized-car.

Kanade T., “Picture Processing System by Computer Complex and Recognition of Human Faces”, Department of Information Science, Kyoto University, 1973.

Kanade T., Computer Recognition of Human Faces, Basel: Birkhäuser, 1977.

Kandel E.R., Reductionism in Art and Brain Science: Bridging the Two Cultures, New York: Columbia University Press, 2016.

Kelly M.D., “Visual Identiﬁcation of People by Computer”, Technical Report AI-130, Stanford AI Project, Stanford, CA 1970.

Kemp R., Pike G., White P., Musselman A., “Perception and Recognition of Normal and Negative Faces: The Role of Shape from Shading and Pigmentation Cues”, Perception 1996, vol. 25, no. 1, pp. 37-52. DOI: 10.1068/p250037.

King H., The Disease of Virgins: Greensickness, Chlorosis and the Problems of Puberty, London: Routledge, 2004.

Lafer-Sousa R., Conway B.R., “Parallel, Multi-Stage Processing of Colors, Faces and Shapes in the Macaque Inferior Temporal Cortex”, Nature Reviews Neuroscience 2013, vol. 16, no. 12, pp. 1870-1878. DOI: 10.1038/nn.3555.

Lafer-Sousa R., Conway B.R., Kanwisher N.G., “Color-Biased Regions of the Ventral Visual Pathway Lie between Face and Place-Selective Regions in Humans, as in Macaques”, Journal of Neuroscience 2016, vol. 36, no. 5, pp. 1682-1697. DOI: 10/1523/JNEUROSCI.3164-15.2016.

Larrington C., The Land of the Green Man: A Journey Through the Supernatural Landscapes of the British Isles, London & New York: I.B. Tauris & Co. Ltd, 2015.

Liu P., Montaser-Kouhsari L., Xu H., “Eﬀects of Face Feature and Contour Crowding in Facial Expression Adaptation”, Vision Research 2014, no. 105, pp. 189-198. DOI: 10.1016/j.visres.2014.10.014.

Livingstone J., “The Remarkable Persistence of the Green Man”, The New Yorker, 7 March 2016, https://www.newyorker.com/books/page-turner/the-remarkable-persistence-of-the-green-man.

Lonzano-Monasor E., López M.T., Vigo-Bustos F., Fernández-Caballero A., “Facial Expression Recognition in Ageing Adults: From Lab to Ambient Assisted Living”, Journal of Ambient Intelligence and Humanized Computing 2017, vol. 8, no. 4, pp. 567-578.

Mahmood Z., ed., Guide to Ambient Intelligence in the IoT Environment: Principles, Technologies and Applications, Berlin: Springer, 2019.

Mâle É., Religious Art in France, XIII Century: A Study in Mediaeval Iconography and its Sources of Inspiration, transl. from the third edition revised and enlarged by D. Nussey, London: J.M. Dent & Sons, 1913.

Matsuno S., Mizuno T., Asano H., Moto K., Itakura N., “Estimating Autonomic Nerve Activity Using Variance of Thermal Face Images”, Artifical Life and Robotics 2018, vol. 23, no. 3, pp. 367-372. DOI: 10.1007/s10015-018-0436-z.

Minami T., Nakajima K., Nakauchi S., “Eﬀects of Face and Background Color on Facial Expression Perception”, Frontiers in Psychology 2018, no. 9 (2012), pp. 1-6. DOI: 10.3389/ psyg.2018.01012.

Ohayon S., Freiwald W.A., Tsao D.Y., “What Makes a Cell Face Selective? The Importance of Contrast”, Neuron 2012, no. 74, pp. 567-581. DOI: 10/1016/j.neuron.2012.03.024.

Oki-Siekierczak A., “‘How green!’ The Meanings of Green in Early Modern England and in The Tempest”, E-rea Online, 2015, http://journals.openedition.org/erea/4465.

Oxenham S., “Facial Recognition: Bristol Research Could Change the World as We Know It”, The Bristol Cable, 21 August 2017, https://thebristolcable.org/2017/08/facial-recognition-bristol-research-change-world-know/.

Pantic M., Bartlett M.S., “Machine Analysis of Facial Expressions”, in: Face Recognition, ed. by K. Delac, M. Grgic, Vienna: I-Tech, 2007, pp. 377-416.

Pastoureau M., Green: The History of a Color, transl. from the French by J. Gladding, Princeton & Oxford: Princeton University Press, 2014.

Pentland A., Choudhury T., “Face Recognition for Smart Environments”, IEEE Computer 2000, pp. 50-55.

Pepperell R., Punt M., The Postdigital Membrane: Imagination, Technology and Desire, London: Intellect Books, 2000, p. 2.

Raglan Lady, “The ‘Green Man’ in Church Architecture”, Folklore 1939, vol. 50, no. 1, pp. 45-75. DOI: 10.1080/0015587X.1939.9718148.

Raglan Lord, The Hero: A Study in Tradition, Myth and Drama, New York: Dover, 2003. Originally published in 1936.

Rothery A., “The Science of the Green Man”, last modiﬁed 2004, http://www.ecopsychology.org/ezine/green_man.html.

Sacks O., The Man Who Mistook His Wife for a Hat, New York: Picador Books, 2015. Originally published 1985.

Sakai T., Nagoa M., Fukibayashi S., “Line Extraction and Pattern Recognition in a Photograph”, Pattern Recognition 1969, vol. 1, no. 3, pp. 233-248.

Samuels A., Jung and the Post-Jungians, Hove, East Sussex & New York: Routledge, 1986.

Schleiner W., “Early Modern Green Sickness and Pre-Freudian Hysteria”, Early Science and Medicine 2009, vol. 14, no. 5, pp. 661-676. DOI: 10.1163/138374209X12465448337628.

Segal R., ed., In Quest of the Hero, Princeton, NJ: Princeton University Press, 1990.

Sinha P., “Identifying Perceptually Signiﬁcant Features for Recognizing Faces”, Proceedings of SPIE Electronic Imaging Symposium 2002, vol. 4662, pp. 12-21. DOI: 10.1117/12.469529.

Smith L.N., Zhang W., Smith M.L., “2D and 3D Face Analysis for Ticketless Rail Travel”, in: International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV’18), ed. by H.R. Arabnia, L. Deligiannidis, F.G. Tinettii, pp. 16-22, Athens, GA: CSREA Press, 2018.

Sorger B., Goebel R., Schiltz Ch., Rossion B., “Understanding the Functional Neuroanatomy of Acquired Prosopagnosia”, NeuroImage 2007, vol. 35, no. 2, pp. 836-852. DOI: 10.1016/j.neuroimage.2006.09.051.

Speirs J., Medieval English Poetry: The Non-Chaucerian Tradition, London: Faber and Faber, 1957.

Stephen I.D., McKeegan A.M., “Lip Color Aﬀects Perceived Sex Typicality and Attractiveness of Human Faces”, Perception 2010, vol. 39, no. 8, pp. 1104-1110. DOI: 10.1068/ p6730.

Stephen I.D., Perrett D.I., “Color and Face Perception”, in: Handbook of Color Psychology, ed. by A. Elliot, M.D. Fairchild, A. Franklin, Cambridge: Cambridge University Press, 2015, pp. 585-602.

Strutt J., Glig-Gamena Angel-Deod: or the Sports and Pastimes of the People of England; Including the Rural and domestic recreations, May-games, mummeries, pageants, processions, and pompous spectacles, from the earliest period to the present time: illustrated by engravings selected from ancient paintings; in which are represented most of the popular diversions, 2nd edition, London: T. Bensley, 1810. Folger Shakespeare Library: https://luna.folger.edu/luna/servlet/detail/FOLGERCM1~6~6~241409~116054:Glig-gamena-angel-deod---or-the-spo.

Torralba A., Pawan S., “Detecting Faces in Impoverished Images”, Artificial Intelligence Laboratory Memos 2001, pp. 1-13. DOI: 10.1167/2.7.601.

Tsao D.Y., Livingstone M.S., “Mechanisms of Face Perception”, Annual Review of Neuroscience 2008, no. 31, pp. 411-437. DOI: 10.1146/annurev.neuro.30.051606.094238.

Tsao D.Y., Schweers N., Moeller S., Freiwald W.A., “Patches of Face-Selective Cortex in the Macaque Frontal Lobe”, Nature Reviews Neuroscience 2008, no. 11, pp. 877-879. DOI: 10.1038/nn.2158.

Turing A., “Intelligent Machinery”, in: Mechanical Intelligence: Collected Works of A.M. Turing, ed. by D.C. Ince, Amsterdam: North Holland, 1992, pp. 107-127. Originally published 1948.

Verner G.R., The Mythic Forest, the Green Man and the Spirit of Nature, Sanford, NC: Algora Publishing, 2006.

Weiser M., “The Computer for the 21st Century”, Scientific American, September 1991, pp. 94-104.

Weiser M., Gold R., Brown J.S., “The Origins of Ubiquitous Computing Research at PARC in the Late 1980s”, IBM Systems Journal 1999, vol. 38, no. 4, pp. 693-696.

Weston P., “End of the Line for Train Tickets? Facial Recognition Software that Identiﬁes Passengers without Stopping Them at Barriers Could Be Rolled Out in the UK by 2020”, MailOnline, 27 July 2017, https://www.dailymail.co.uk/sciencetech/article-4734928/Facial-recognition-technology-end-train-tickets.html?printingPage=true.

Wilkins A.S., Making Faces: The Evolutionary Origins of the Human Face, Cambridge, MA: The Belknap Press of Harvard University Press, 2017.

Winner L., “Who Will We Be in Cyberspace?”, The Information Society 1996, vol. 12, no. 1, pp. 63-72. DOI: 10.1080/019722496129701.

Yip A.W., Sinha P., “Contribution of Color to Face Recognition”, Perception 2002, no. 31, pp. 995-1003. DOI:10.1068/p3376.

Information

Information: Arts & Cultural Studies Review, 2018, Issue 4 (38), pp. 493 - 535

DOI: https://doi.org/10.4467/20843860PK.18.026.10364

Article type: Original article

Titles:

Polish:

GREENING FACE: How Facial Expression is Made Sensible, from Pre-Christian Architectural Spaces to Post-Digital Smart Environments

English:

GREENING FACE: How Facial Expression is Made Sensible, from Pre-Christian Architectural Spaces to Post-Digital Smart Environments

Authors

Devon Schiller

https://orcid.org/0000-0002-3930-7363

Department of English and American Studies, University of Vienna

Published at: 13.03.2019

Article status: Open

Licence: CC BY-NC-ND

Percentage share of authors:

Devon Schiller (Author) - 100%

Article corrections:

-

Publication languages:

English

View count: 2105

Number of downloads: 1237

<p> GREENING FACE: How Facial Expression is Made Sensible, from Pre-Christian Architectural Spaces to Post-Digital Smart Environments</p>

Pobierz pełny tekst

Titles

Abstract

Keywords

References

Information

Authors