John M. Scholes Explained
John Morley Scholes (1948–2019) was a British computer scientist. In his professional career he was devoted to the development of the programming language APL. He was the designer and implementer of direct functions.
Personal
John Scholes was born on 24 April 1948 to Gerry and Amy Scholes. He grew up in Leamington Spa, Warwickshire, England, and attended Leamington College for Boys between 1960 and 1966. Between 1966 and 1969 he attended the University of Manchester and received a BSc (with honours) in mathematics.
Scholes enjoyed poetic and romantic qualities in his life. Apart from APL, he also found beauty in nature, opera, the music of Tom Waits, the literature of James Joyce, the poetry of W. B. Yeats. He was a member of the Joyce society in Dublin. In 2013, he and his wife Flora Dowling went to Sligo to the W. B. Yeats Summer School and met the poet Seamus Heaney the summer before Heaney died.
The APL side and the romantic side often met: The Depth-First Search video (below) was recorded at dawn on the summer solstice of 2014, with birdsong in the air, while he and his wife were on a 21-day Zen retreat in France led by Thích Nhất Hạnh. Scholes was pleased with both the technical content and the circumstances of that work.
Career
Scholes's first job was as a trainee computer programmer with International Computers Limited (ICL) (1969–70) and from there he went on to the Operations Research Department of WS Atkins in Epsom, Surrey (1971–75) and then to the Sales Support Department in Warrington, Lancashire (1976–77). Between 1977 and 1978 he worked with the European Space Agency in Madrid, Spain as a programmer for the International Ultraviolet Explorer project. He then returned to ICL Dataskil working on APL for the VME/B operating system (1978–82). In 1982, he started the Dyalog APL project for Unix machines,[2] and in 1988 became a partner and director of the Dyalog Company. In 2004, Scholes sold his shares in the company, but continued as a consultant and, in his words, pursued his passionate interest in APL programming on various mathematical topics in general and functional programming and dfns in particular. Or "nerding", as he also called it.
Direct functions (dfns)
See main article: Direct function.
Kenneth E. Iverson, the inventor of APL, was dissatisfied with the way user functions were defined. In 1974, he devised "formal function definition" or "direct definition" for use in exposition. A direct definition has two or four parts, separated by colons:name : expressionname : expression0 : proposition : expression1Within a direct definition, denotes the left argument and the right argument. In the first instance, the result of is the result of the function; in the second instance, the result of the function is that of if evaluates to 0, or if it evaluates to 1. Assignments within a direct definition are dynamically local. Examples of using direct definition are found in the 1979 Turing Award Lecture[3] and in books and application papers.[4] [5] [6]
Direct definition was too limited for use in larger systems. The ideas were further developed by multiple authors in multiple works,[7] [8] [9] [10] but the results were unwieldy. Of these, the "alternative APL function definition" of Bunda in 1987[9] came closest to current facilities, but is flawed in conflicts with existing symbols and in error handling which would have caused practical difficulties, and was never implemented. The main distillates from the different proposals were that (a) the function being defined is anonymous, with subsequent naming (if required) being effected by assignment; (b) the function is denoted by a symbol and thereby enables anonymous recursion.
In 1996, Scholes invented direct functions or dfns (pronounced "dee funs"), a major distinguishing advance of early 21st century APL over prior versions.[11] [12] Dfns are a unique combination of array programming, higher-order functions, and functional programming. The ideas originated in 1989 when he read a special issue of The Computer Journal on functional programming.[13] He then proceeded to study functional programming and became strongly motivated ("sick with desire", like Yeats) to bring these ideas to APL.[12] He initially operated in stealth because he was concerned the changes might be judged too radical and an unnecessary complication of the language; other observers say that he operated in stealth because Dyalog colleagues were not so enamored and thought he was wasting his time and causing trouble for people. Dfns were first presented in the Dyalog Vendor Forum at the APL '96 Conference and released in Dyalog APL in early 1997.[11] Acceptance and recognition were slow in coming. As late as 2008, in Dyalog at 25,[14] a publication celebrating the 25th anniversary of Dyalog Ltd, dfns were barely mentioned (mentioned twice as "dynamic functions" and without elaboration). As of 2019, dfns are implemented in Dyalog APL,[15] NARS2000, and ngn/apl.[16] They also play a key role in efforts to exploit the computational capabilities of a GPU (graphics processing unit).[17] [18]
Dfns are illustrated here with an example. Much more extensive explanation and examples are found in the direct functions article and in the references.[18]
Quicksort on an array works by choosing a "pivot" at random among its major cells, then catenating the sorted major cells which strictly precede the pivot, the major cells equal to the pivot, and the sorted major cells which strictly follow the pivot, as determined by a comparison function . Defined as a dop (direct operator) : Q←
⍝ precedes ⍝ follows ⍝ equals 2 (×-) 8 8 (×-) 2 8 (×-) 8¯1 1 0
x← 2 19 3 8 3 6 9 4 19 7 0 10 15 14
(×-) Q x0 2 3 3 4 6 7 8 9 10 14 15 19 19
is a variant that catenates the three parts enclosed by the function instead of the parts per se. The three parts generated at each recursive step are apparent in the structure of the final result. Applying the function derived from to the same argument multiple times gives different results because the pivots are chosen at random. In-order traversal of the results does yield the same sorted array. Q3←
(×-) Q3 x┌────────────────────────────────────────────┬─────┬┐│┌──────────────┬─┬─────────────────────────┐│19 19││││┌──────┬───┬─┐│6│┌──────┬─┬──────────────┐││ │││││┌┬─┬─┐│3 3│4││ ││┌┬─┬─┐│9│┌┬──┬────────┐│││ │││││││0│2││ │ ││ ││││7│8││ │││10│┌──┬──┬┐││││ │││││└┴─┴─┘│ │ ││ ││└┴─┴─┘│ │││ ││14│15││││││ ││││└──────┴───┴─┘│ ││ │ │││ │└──┴──┴┘││││ ││││ │ ││ │ │└┴──┴────────┘│││ ││││ │ │└──────┴─┴──────────────┘││ │││└──────────────┴─┴─────────────────────────┘│ ││└────────────────────────────────────────────┴─────┴┘ (×-) Q3 x┌───────────────────────────┬─┬─────────────────────────────┐│┌┬─┬──────────────────────┐│7│┌────────────────────┬─────┬┐││││0│┌┬─┬─────────────────┐││ ││┌──────┬──┬────────┐│19 19││││││ │││2│┌────────────┬─┬┐│││ │││┌┬─┬─┐│10│┌──┬──┬┐││ ││││││ │││ ││┌───────┬─┬┐│6│││││ │││││8│9││ ││14│15││││ ││││││ │││ │││┌┬───┬┐│4│││ │││││ │││└┴─┴─┘│ │└──┴──┴┘││ ││││││ │││ │││││3 3│││ │││ │││││ ││└──────┴──┴────────┘│ ││││││ │││ │││└┴───┴┘│ │││ │││││ │└────────────────────┴─────┴┘││││ │││ ││└───────┴─┴┘│ │││││ │ ││││ │││ │└────────────┴─┴┘│││ │ ││││ │└┴─┴─────────────────┘││ │ ││└┴─┴──────────────────────┘│ │ │└───────────────────────────┴─┴─────────────────────────────┘
The above formulation is not new; see for example Figure 3.7 of the classic The Design and Analysis of Computer Algorithms. However, unlike the pidgin ALGOL program in Figure 3.7, and are executable, and the partial order used in the sorting is an operand, the the examples above.[18]
Articles and presentations
- 1985 Operators & Nested Arrays in Dyalog APL
- 1989 ⎕SM: A Full-Screen Manager for Dyalog APL[19]
- 1990 Workshop on Defined Operators
- 1990 A New Development Environment in Dyalog APL
- 1994 Meeting: Dyalog APL Namespaces
- 1996 Direct Functions in Dyalog APL[20]
- 1998 APL98 Workshop – Threads in Dyalog APL
- 1998 Threads: An Introduction to Multithreading
- 2001 D: A Functional Subset of Dyalog APL
- 2001 Letter: Localising the Effects of System Functions in D
- 2003 dfns@dyalog.com
- 2003 Hungarian Method Cost Assignment
- 2004 A Note on Graphs
- 2005 How to Write Computer Programs
- 2006 Language Extensions
- 2006 Functions as Results
- 2007 Version 11.1 Performance Enhancements
- 2007 An Investigation into Higher Level Operators
- 2008 Interpreter Performance
- 2008 Journaled Files (video)[21] (text)
- 2008 A Plea for Simplicity (video)[22]
- 2009 Conway's Game of Life in APL (video)[23]
- 2009 Introduction to D-functions (videos 1,[24] 2[25])
- 2009 Session Whizbangs
- 2009 Complex Numbers (video)[26]
- 2010 Workshop—Introduction to D-functions (video 1)[27] (video 2)[28]
- 2011 Conference Edition Workshop
- 2011 Introducing the Dyalog '11 Conference Edition
- 2011 APL# (video)[29] (text)
- 2011 Function Trains for Dyalog APL
- 2011 What is Functional Programming? (video)[30]
- 2011 Closures
- 2012 Potential Version 14.0 Language Features (video)[31] (text)
- 2012 State-Free Programming (video)[32]
- 2012 Calling Alan Turing (video)[33]
- 2012 A Sudoku Solver in APL (video)[34]
- 2013 Train Spotting in Version 14.0 (video)[35] (text)
- 2013 Social Skills for Programmers (video)[36]
- 2014 Depth-First Search in APL (video)[37]
- 2014 Distractions (video)[38]
- 2015 Dya(b)log (video)[39] (text)
- 2015 Future Operator Proposals: Cut, Under, and Merge (video)[40] (text)[41]
- 2016 New Primitive Functions and Operators (video)[42] (text) (script)
- 2016 Dyalog Implementation: The Early Years (video)[43]
- 2017 A Case Study: Recoding from Procedural to Denotative Style (video)[44] (text)
- 2018 Dfns—Past, Present and Future (video)[12] (text)
Wit
Scholes was well known among colleagues for his wit, sense of humor, and comic timing. His "after dinner" presentations at Dyalog conferences were highly anticipated events. A selection of them from the list above:
- 2008 A Plea for Simplicity (video)[22]
- 2009 Complex Numbers (video)[26]
- 2011 What is Functional Programming? (video)[30]
- 2012 State-Free Programming (video)[32]
- 2012 Calling Alan Turing (extract of previous item, video)[33]
- 2013 Social Skills for Programmers (video)[36]
- 2014 Distractions (video)[38]
Other examples can be found in Scholisms.
External links
Notes and References
- Web site: Kenneth E. Iverson Award . . 15 September 2019.
- Polivka . Ray . An Interview with Peter Donnelly and John Scholes . APL Quote Quad . 28 . 3 . March 1998. 7–12 . 10.1145/309730.309731 . 28437582 .
- Iverson . Kenneth E. . Kenneth E. Iverson . Notation as a Tool of Thought . . 23 . 8 . August 1980 . 8 April 2016. 10.1145/358896.358899. 444–465. free .
- Book: Iverson, Kenneth E. . Kenneth E. Iverson . Elementary Analysis . APL Press. 1976.
- Book: Orth, D.L. . Calculus in a New Key. APL Press . 1976.
- Hui . Roger . Roger Hui . Some Uses of . APL 87 Conference Proceedings . May 1987 . 15 April 2016.
- Iverson . Kenneth E. . Kenneth E. Iverson . Wooster . Peter . A Function Definition Operator . APL81 Conference Proceedings, APL Quote Quad . 12 . 1 . September 1981.
- Iverson . Kenneth E. . Kenneth E. Iverson . A Dictionary of APL . APL Quote Quad . 18 . 1 . September 1987 . 5–40 . 10.1145/36983.36984 . 18301178 . 19 September 2019.
- Bunda . John . APL Function Definition Notation . APL87 Conference Proceedings, APL Quote Quad . 17 . 4 . May 1987.
- Book: Hui, Roger . Conference proceedings on APL 90: For the future . APL\? . Roger Hui . etal . 20 . 4 . July 1990 . 192–200 . 10.1145/97808.97845 . 089791371X . 235453656 . http://www.jsoftware.com/papers/J1990.htm . 2019-09-10.
- Scholes . John . Direct Functions in Dyalog APL . Vector . 13 . 2 . October 1996 . 16 September 2019.
- Scholes . John . 31 October 2018 . Dfns: Past, Present and Future . video . Dyalog '18 User Meeting . 21 September 2019.
- Wadler . Philip L. . etal . Special Issue on Functional Programming . . 32 . 2 . 1 January 1989.
- Dyalog . Dyalog at 25 . Vector . September 2008 . 2019-09-20.
- Book: Dyalog. Dyalog Programming Reference Guide, version 17.1, Dfns & Dops, pp. 133-147. Dyalog Ltd.. 15 August 2019. 30 September 2019.
- Nickolov . Nick . Compiling APL to JavaScript . Vector . 26 . 1 . September 2013 . 19 September 2019.
- Hsu . Aaron . A Data Parallel Compiler Hosted on a GPU (pre-print draft) . Ph.D. . . 2019.
- Hui . Roger . Roger Hui . Kromberg . Morten . APL Since 1978 . Proceedings of the ACM on Programming Languages . 4 . HOPL . June 2020 . 1–108 . 10.1145/3386319 . 218517570 . free .
- Curtin . A.D. . Scholes . J.M. . ⎕sm: A Full-Screen Manager for Dyalog APL . APL Quote Quad . 19 . 4 . August 1989. 107–112 . 10.1145/75145.75159 .
- Scholes . John . Direct Functions in Dyalog APL . Vector . 13 . 2 . October 1996 . 16 September 2019.
- Scholes . John . Smith . Richard . 13 October 2008 . Journaled Files . video . Dyalog '08 User Conference . 21 September 2019.
- Scholes . John . 13 October 2008 . A Plea for Simplicity . video . Dyalog '08 User Conference . 21 September 2019.
- Scholes . John . 26 January 2009 . Conway's Game of Life in APL . video . . 21 September 2019.
- Scholes . John . 13 September 2009 . Introduction to D-functions . video . Dyalog '09 User Conference . 21 September 2019.
- Scholes . John . 13 September 2009 . Introduction to D-functions . video . Dyalog '09 User Conference . 21 September 2019.
- Scholes . John . 14 September 2009 . Complex Numbers . video . Dyalog '09 User Conference . 21 September 2019.
- Scholes . John . 14 September 2010 . Workshop—Introduction to D-functions . video . Dyalog '10 User Conference . 21 September 2019.
- Scholes . John . 14 September 2010 . Workshop—Introduction to D-functions . video . Dyalog '10 User Conference . 21 September 2019.
- Kromberg . Morten . Scholes . John . Manktelow . Jonathan . 3 October 2011 . APL# . video . Dyalog '11 User Conference . 21 September 2019.
- Scholes . John . Hui . Roger . Roger Hui . 3 October 2011 . What is Functional Programming? . video . Dyalog '11 User Conference . 21 September 2019.
- Scholes . John . Hui . Roger . Roger Hui . 15 October 2012 . Potential Version 14.0 Language Features . video . Dyalog '12 User Conference . 21 September 2019.
- Scholes . John . 15 October 2012 . State-Free Programming . video . Dyalog '12 User Conference . 21 September 2019.
- Scholes . John . 15 October 2012 . Calling Alan Turing . video . Dyalog '12 User Conference . 22 September 2019.
- Scholes . John . 27 October 2012 . A Sudoku Solver in APL . video . . 21 September 2019.
- Scholes . John . 22 October 2013 . Train Spotting in Version 14.0 . video . Dyalog '13 User Conference . 21 September 2019.
- Scholes . John . 22 October 2013 . Social Skills for Programmers . video . Dyalog '13 User Conference . 21 September 2019.
- Scholes . John . 21 June 2014 . Depth-First Search in APL . video . . 21 September 2019.
- Scholes . John . 22 September 2014 . Distractions . video . Dyalog '14 User Meeting . 21 September 2019.
- Smith . Fiona . Scholes . John . Smith . Richard . Hui . Roger . Roger Hui . 7 September 2015 . Dya(b)log . video . Dyalog '15 User Meeting . 21 September 2019.
- (text)
- (text)
- Scholes . John . Hui . Roger . Roger Hui . 10 October 2016 . New Primitive Functions and Operators . video . Dyalog '16 User Meeting . 21 September 2019.
- Taylor . Stephen . Streeter . Geoff . Scholes . John . 12 October 2016 . Dyalog Implementation: The Early Years . video . Dyalog '16 User Meeting . 21 September 2019.
- Scholes . John . 11 September 2017 . A Case Study: Recoding from Procedural to Denotative Style . video . Dyalog '17 User Meeting . 21 September 2019.