Abstract:Testing of and with cyber-cyber digital twins
This talk will cover our approach to testing of (and with) cyber-cyber digital twins. A cyber-cyber digital twin is a deployed software model that executes in tandem with the system it simulates, contributing to, and drawing from, that system’s behaviour. This talk outlines Meta’s cyber-cyber digital twin, WW, a twin of the Meta WWW platforms, including Facebook and Instagram. WW is built using Web-Enabled Simulation. The talk will cover research challenges and opportunities in the general area of software testing and will include opportunities and open problems for further research on metamorphic testing. Metamorphic testing is well-suited to the problem of testing of (and with) cyber-cyber digital twins, because these twins involve inherently unknowable test oracles, thereby denoting the most pernicious form of oracle challenge for automated software testing.
This talk reports the results of joint work with Sophia Drossopoulou, Inna Dvortsova, Natalija Gucevska, Michal Krolikowski, Maria Lomeli, Simon Lucas, Rubmary Rojas, and Silvia Sapora.
Kinga Bojarczuk graduated from King’s College London with a Bachelor’s degree in Computer
Science with Artificial Intelligence with a Year Abroad at University of Toronto. She received a
King’s Experience Research Award for her work on Graph Transformation Systems.
She worked as a Research Assistant in multiple projects covering a variety of topics including
Multi-agent Simulation Systems, Graph Transformation Systems and Big Data Statistics at King’s
In 2020 Kinga started work at Facebook, where she’s been working on Facebook’s WW Web Enabled
Simulation system, a platform on which Facebook simulates user communities on the real
Kinga and her co-authors have published results from this work at the 43rd International
Conference on Software Engineering (ICSE 2021) as well as in invited keynote papers at the 8th
Genetic Improvement Workshop (GI 2020),
the 15th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
(ESEM 2021), the 9th Realising Artificial Intelligence Synergies with Software Engineering
(RAISE 2021) workshop and the 25th International Conference on Evaluation and Assessment in
Software Engineering (EASE 2021).
Mark Harman is a full-time Software Engineer in the Testing and Verification team at Meta Platforms, working on Simulation-Based Testing. Simulation-based testing is helping to tackle challenging technical problems in software integrity and privacy, helping keep users safe online when using Meta platforms such as Facebook and Instagram. Mark is also a part-time professor at UCL, and was previously the manager of the Facebook Sapienz team, which grew out of Majicke, a start up he co-founded that was acquired by Facebook (now Meta Platforms) in 2017. Since then, Sapienz has been fully deployed as part of Meta’s overall continuous integration and is a key part of its app store deployment process. The Sapienz team continues to develop and extend it. Sapienz has found and helped to fix thousands of bugs before they hit production, on systems of tens of millions of lines of code, daily relied upon by over 2.8 billion people. Prior to working at Facebook, Mark was head of Software Engineering at UCL and director of its CREST centre. In his more purely scientific work, Mark co-founded the field Search Based Software Engineering (SBSE) in 2001, now the subject of active research in over 40 countries worldwide. He received the IEEE Harlan Mills Award and the ACM Outstanding Research Award in 2019 for his work, and was awarded a fellowship of the Royal Academy of Engineering in 2020.