Edward Y. Chang Explained

Edward Y. Chang (張智威)
Birth Place:Taipei, Taiwan
Nationality:American
Occupation:Computer scientist, academic, and author
Awards:Fellow of ACM & IEEE
Website:http://infolab.stanford.edu/~echang/
Education:PhD, Stanford University
Alma Mater:Stanford University
University of California, Berkeley
Workplaces:Stanford University

Edward Y. Chang is a computer scientist, academic, and author. He is an adjunct professor of Computer Science at Stanford University,[1] and Visiting Chair Professor of Bioinformatics and Medical Engineering at Asia University, since 2019.[2]

Chang is the author of six books, including The Path to Artificial General Intelligence-Insights from Adversarial LLM Dialogue (2024),Foundations of Large-Scale Multimedia Information Management and Retrieval, Big Data Analytics for Large-Scale Multimedia Search, Journey of the Mind (poetry),Nomadic Eternity (poetry), and the Mandarin translation of Erwin Schrödinger's What is Life? Mind and Matter. His research interests span consciousness modeling, generative artificial intelligence, and health care, for which he has received numerous awards such as the Google Innovation Award,[3] XPRIZE Award, and the Presidential Award of Taiwan for his work containing the COVID-19 outbreak. He is also a fellow of ACM Association for Computing Machinery[4] and fellow of IEEE Institute of Electrical and Electronics Engineers[5] for his contributions to scalable machine learning and healthcare.

Education

Chang completed his Master of Science in Industrial Engineering and Operations Research at the University of California, Berkeley before pursuing further studies at Stanford University. He received his Master of Science in Computer Science from Stanford in 1994 and then went on to pursue a Ph.D. in Electrical Engineering at the same institution. From 1995 to 1999, he worked under his advisor, Héctor García-Molina, and obtained his doctoral degree.[2]

Career

Chang started his academic career at the University of California, Santa Barbara where he served as an Assistant, Associate, and eventually Full Professor of Electrical & Computer Engineering from 1999 to 2006. Between 2012 and 2015, he was appointed as an adjunct professor in Computer & Information Science at Hong Kong University of Science and Technology (HKUST), Hong Kong. This was followed by an appointment as a visiting professor at the Future Reality center in the EECS department of University of California, Berkeley from 2017 to 2020.[6] Since 2019, he has been holding appointments as the adjunct professor of Computer Science at Stanford University[1] and Visiting Chair Professor of Bioinformatics and Medical Engineering at Asia University.[2]

Chang was Director of Research at Google from 2006 to 2012. During this time, he led research and development initiatives in several areas, including scalable machine learning,[7] recommendation systems,[8] indoor localization,[9] and Google QA.[10] He also served as the Chief NLP Advisor at SmartNews, a Tokyo-based company, from 2019 to 2022, where he contributed in developing interactive news. He founded Ailly.ai, a Palo Alto-based company, where he serves as the Founder and Chief technology officer (CTO) since 2019.[12]

Research

Chang has authored numerous peer-reviewed publications,[13] and holds multiple patents.[14]

SocraSynth for knowledge discovery and verification

In 2019, Chang embarked on his exploration of consciousness modeling, with the goal of enhancing AI reasoning capabilities. His groundbreaking work in 2023 pioneered the application of the Socratic method to AI, fostering critical reading and thinking. He then introduced SocraSynth (Socratic Synthesis),[15] a framework that convenes multiple Large Language Models (LLMs) in a collaborative and adversarial dialogue. Guided by statistical and information theory principles, this approach balances exploring novel perspectives with exploiting known information. The goal is to uncover knowledge and insights previously inaccessible to human understanding. Following discovery, the Socratic method and rigorous logical reasoning are employed for critical examination and verification, ensuring the reasonableness of findings, if not absolute truth. The early results have shown SocraSynth to be effective in identifying and rectifying content biases and misdiagnoses.

Parallelizing machine learning algorithms

As early as 2005, Chang was developing the data-centric approach to machine learning, and led his teams at Google from 2006 to 2011 in the development of parallel versions of five commonly used machine-learning algorithms that could handle large datasets: PSVM for Support Vector Machines,[16] PFP for Frequent Itemset Mining,[17] PLDA for Latent Dirichlet Allocation,[18] PSC for Spectral Clustering,[19] and SPeeDO for Parallel Convolutional Neural Networks.[20] Through his research on PSVM, he demonstrated that matrix factorization can be used to distribute the solver of the Interior Point Method across multiple machines, while utilizing a row-based Incomplete Cholesky Factorization to decrease both memory and computation requirements. This approach allows PSVM to effectively reduce memory needs from O(n^2) to O(n) and computation complexity from O(n^3) to O(n) for each of the square-root(n) parallel computation units (CPUs/GPUs), when working with n training instances.[21] In addition, one of his papers, culminating from the research conducted at University of California at Santa Barbara proposed a content-based soft annotation (CBSA) procedure that improves image labeling accuracy by employing an ensemble of binary classifiers and comparing the performance of SVMs and BPMs.[22] While addressing the imbalanced training-data problems in emerging applications such as image retrieval, video surveillance with G Wu, he proposed a class-boundary-alignment algorithm,[23] and also proposed a kernel-boundary-alignment algorithm for SVM-based supervised learning tasks, demonstrating its effectiveness through theoretical analysis and empirical studies.[24] Later in related research, he proved that DeepWalk is equivalent to matrix factorization, and introduced Text-Associated DeepWalk, a method that incorporates text features into network representation learning and outperforms other baselines on multi-class classification tasks, particularly in noisy networks with a small training ratio.[25]

Improving training data effectiveness via active learning

Chang's research had made contributions to the field of machine learning with a particular focus on active learning by improving the effectiveness of training data and providing insights for the development of more efficient healthcare technologies. Together with Simon Tong, his SVMActive work addressed the shortage of labeled data available for classifier training in applications such as the healthcare sector by utilizing active learning to identify ambiguous unlabeled instances and query experts, such as physicians, to provide labels, thus maximizing information gain. Initially, this approach was employed to enhance relevance feedback in image-query refinement.[26] In the healthcare sector, he particularly integrated sparse-space active learning with reinforcement learning to enable a doctor-agent to decide on the next symptom query for a patient, optimizing diagnostic accuracy with minimal symptom-probing iterations. Moreover, along with a group of researchers, he proposed the REFUEL algorithm which addresses the challenge of sparse symptoms in disease diagnosis using reward shaping and feature rebuilding strategies to guide the symptom-space search and eliminate correlated symptoms iteratively.[27] REFUEL has also been implemented for remote diagnosis and triage by two hospital chains in Taiwan and by Taiwan CDC in the fight against COVID-19.[28]

Chang and his team developed a mobile device powered by the REFUEL system, which could diagnose twelve common diseases by performing various laboratory tests. His joint paper published in 2017, provided a detailed account of the design of the DeepQ AI-powered symptom checker's key components, such as the optical sense and vital sense modules. These modules were integrated into a mobile device that was designed to offer a user-friendly experience. This work on symptom checker was also recognized in 2017 when the device won second prize in the Qualcomm Tricorder XPRIZE competition.[29] Additionally, his chatbot-based symptom-checking system, developed in collaboration with Taiwan CDC, received the Presidential Award in 2020 for effectively containing the COVID-19 outbreak. His other prominent contributions to the healthcare technology field include the development and annotation of the DeepQ Arrhythmia Database. This database provides a collection of ECG recordings from patients engaged in various activities, complementing the MIT BIH Arrhythmia Database. The DeepQ Arrhythmia Database facilitates machine learning studies while addressing the issue of interpatient variability.[30]

Other key contributions

Chang is also credited as the inventor of DVR, which replaced the traditional tape-based VCR in 1999 and introduced interactive features for streaming videos. In 1997, he designed the Digital video recorder (DVR), which was developed in 1998 as a chapter of his PhD dissertation under the supervision of Hector Garcia-Molina and Pat Hanrahan.[31] [32]

Awards and honors

Bibliography

Books

Selected articles

Notes and References

  1. Web site: Edward Y. Chang - Stanford Profile.
  2. Web site: Edward Chang- Chair Professor - Asia University.
  3. Web site: Edward Chang - Confucius and Its Intelligent Disciples: Integrating Social with Search.
  4. Web site: ACM Award Recipients.
  5. Web site: IEEE Computer Society Members Elevated to Fellow for 2017. 9 April 2018 .
  6. Web site: Model Generative Artificial Intelligence with Consciousness.
  7. Web site: Data Management Projects at Google, SIGMOD Record, March 2008 (Vol. 37, No. 1).
  8. Book: Combinational Collaborative Filtering for Personalized Community Recommendation, ACM KDD, 2008. 24 August 2008 . 115–123 . 10.1145/1401890.1401909 . 978-1-60558-193-4 . 508926 .
  9. Web site: Moving Direction Determination, US Patent, 2013 .
  10. Web site: Taiwan CDC's chatbot upgraded on its 1st birthday: Answering infectious disease-related questions via LINE.
  11. Previously, he held an appointment as the Chief Technical Advisor for Video Surveillance at Proximex located in Cupertino, California from 2004 to 2006. In 2012, he became the President of HTC Healthcare.[10]
  12. Web site: Edward Y. Chang - Stanford homepage.
  13. Web site: Edward Y Chang - Google Scholar Profile.
  14. Web site: Google Patents - Edward Y. chang.
  15. Web site: SocraSynth: Dive Deeper, Illuminate the Unknown with Generative AI.
  16. Web site: Parallelizing Support Vector Machines on Distributed Computers. 2007 . 20 .
  17. Book: Proceedings of the 2008 ACM conference on Recommender systems . 23 October 2008 . 107–114 . 10.1145/1454008.1454027 . 9781605580937 . 16453090 . PFP: Parallel fp-growth for query recommendation . Li . Haoyuan . Wang . Yi . Zhang . Dong . Zhang . Ming . Chang . Edward Y. .
  18. Book: https://dl.acm.org/doi/10.1007/978-3-642-02158-9_26. PLDA: Parallel Latent Dirichlet Allocation for Large-Scale Applications. 10.1007/978-3-642-02158-9_26 . Algorithmic Aspects in Information and Management . Lecture Notes in Computer Science . 2009 . Wang . Yi . Bai . Hongjie . Stanton . Matt . Chen . Wen-Yen . Chang . Edward Y. . 5564 . 301–314 . 978-3-642-02157-2 .
  19. Parallel Spectral Clustering in Distributed Systems. 2011 . 10.1109/TPAMI.2010.88 . Chen . Wen-Yen . Song . Yangqiu . Bai . Hongjie . Lin . Chih-Jen . Chang . Edward Y. . IEEE Transactions on Pattern Analysis and Machine Intelligence . 33 . 3 . 568–586 . 20421667 . 6703419 .
  20. Web site: SpeeDO: Parallelizing Stochastic Gradient Descent for Deep Convolutional Neural Network.
  21. Book: https://link.springer.com/chapter/10.1007/978-3-642-20429-6_10. PSVM: Parallelizing Support Vector Machines on Distributed Computers. 10.1007/978-3-642-20429-6_10 . Foundations of Large-Scale Multimedia Information Management and Retrieval . 2011 . Chang . Edward Y. . 213–230 . 978-3-642-20428-9 .
  22. CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines. 2003 . 10.1109/TCSVT.2002.808079 . Chang . E. . Kingshy Goh . Sychay . G. . Gang Wu . IEEE Transactions on Circuits and Systems for Video Technology . 13 . 26–38 .
  23. Web site: Class-Boundary Alignment for Imbalanced Dataset Learning.
  24. KBA: kernel boundary alignment considering imbalanced data distribution. 2005 . 10.1109/TKDE.2005.95 . Wu . G. . Chang . E.Y. . IEEE Transactions on Knowledge and Data Engineering . 17 . 6 . 786–795 . 7934922 .
  25. Book: Network representation learning with rich text information. 25 July 2015 . 2111–2117 . 9781577357384 . Yang . Qiang . Wooldridge . Michael J. . AAAI Press .
  26. Book: https://dl.acm.org/doi/10.1145/500141.500159. Support vector machine active learning for image retrieval. 10.1145/500141.500159 . Proceedings of the ninth ACM international conference on Multimedia . 2001 . Tong . Simon . Chang . Edward . 107–118 . 1581133944 . 10743717 .
  27. Web site: REFUEL: exploring sparse features in deep reinforcement learning for fast disease diagnosis. 3 December 2018 . 7333–7342 .
  28. Web site: Zhangji launched Taiwan's first cross-hospital AI + blockchain doctor Lan medical care dialogue robot.
  29. Book: https://dl.acm.org/doi/10.1145/3132635.3132637. Artificial Intelligence in XPRIZE DeepQ Tricorder. 10.1145/3132635.3132637 . Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care . 2017 . Chang . Edward Y. . Wu . Meng-Hsi . Tang . Kai-Fu Tang . Kao . Hao-Cheng . Chou . Chun-Nan . 11–18 . 9781450355049 . 8174727 .
  30. Book: Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care . 23 October 2017 . 77–80 . 10.1145/3132635.3132647 . 9781450355049 . 23572593 . DeepQ Arrhythmia Database: A Large-Scale Dataset for Arrhythmia Detector Evaluation . Wu . Meng-Hsi . Chang . Edward Y. .
  31. Book: Effective Memory Use in a Media Server. 25 August 1997 . 496–505 . 9781558604704 . Jarke . Matthias . Elsevier Science & Technology Books .
  32. Book: https://ieeexplore.ieee.org/document/779251. MEDIC: a memory and disk cache for multimedia clients. 10.1109/MMCS.1999.779251 . Proceedings IEEE International Conference on Multimedia Computing and Systems . 1999 . Chang . E. . Garcia-Molina . H. . 1 . 493–499 . 0-7695-0253-9 . 7597582 .
  33. Web site: CONGRATULATIONS TO OUR WINNERS! - Qualcomm Tricorder XPRIZE awards. 2023-03-21. 2017-09-21. https://web.archive.org/web/20170921001305/https://tricorder.xprize.org/teams. dead.