Taking the Pain out of Probes*

* I have unashamedly stolen this title from my friend and erstwhile colleague at Nottingham, Richard Woolley. Rich, I hope you’ll forgive the plagiarism.  


Scanning probe microscopy is my first love when it comes to experimental science. Although I’ve spent quite a bit of time at synchrotrons over the years, I still turn to SPM first and foremost when it comes to probing the structure of matter. After all, what other technique allows us to not only see single atoms and molecules, but to interrogate them mercilessly, reaching down to the level of individual chemical bonds, and pick, prod, push, and/or pull them around a surface? What other technique enables us to capture not only the electronic structure (both filled and empty states in a single “shot”), but the vibrational “wobbles”, the potential energy landscape (of various forms), the probability density, and even the magnetic signature of a single atom or molecule (in parallel, and with energy resolutions that are in essence only thermally limited)?

And, as I suspect my fellow probe microscopists would heartily agree, what other technique is quite so damn irritating, fist-clenchingly frustrating, and hair-pullingly maddening at times?

Probe microscopists can spend hours, days, or sometimes even weeks trying to cajole the component at the very core of the microscope — the tip (or, more precisely, the atomistic structure at the very apex of the tip) — into behaving itself. We use a variety of recipes to modify the tip apex, ranging from rather gentle and delicate indentations (pushing the probe a few angstroms into the surface), picking up a molecule, or rather “tame” voltage pulses of a few volts… to plunging in, burying the probe, and ploughing a furrow across the substrate. And then we scan and hope to see atomic resolution. But even if we see atoms, it mightn’t be the right type of atomic resolution [1]. We might have a double tip (i.e. two atoms are involved in forming the image), or a triple tip, or, something else entirely


Those images above are all of the atomic structure of the Si(100) surface (as described in this video, and as sketched in the top right corner of the slide, where we’re looking down on the surface. Large circles represent atoms that are “buckled” out of the surface, creating a zig-zag pattern — technically, a c(4×2) reconstruction — of non-planar pairs of atoms (dimers).) In each case, the surface has the same atomic structure — the variations from image to image are purely tip-related. And if we find the tip in a state that doesn’t give us the image we expect or need [2] then we crash, or hammer, or pulse, or bash, and swear repeatedly until we get what we want. Sometimes — usually around five minutes to lunchtime, or 5 pm on a Friday evening — the tip gets better. Other times it gets much, much worse. So we sit there for hours, trying to recover the tip. Or we change it for a new one. And then try to coerce that into showing us atoms, or more than atoms.

But we don’t need to suffer like this. There is a better way. And finding that lower — and hopefully minimum — frustration pathway to better probe microscopy was the subject of a meeting at the Institute of Physics on Friday. Organised by Martin Castell (Oxford) and myself, the theme of the meeting was machine learning for atomic resolution scanning tunnelling mcirscopy (STM) and atomic force microscopy (AFM.) In attendance were scientists from across the UK who each wanted to move our field forward so as to take the pain away (and, of course, consequently do rather more interesting experiments/theoretical calculations as well.) Oxford, Nottingham, King’s College London, Newcastle, Loughborough, University College London, Warwick, Liverpool Physics, St. Andrews, and Swansea were each represented on the day, with apologies from SPM researchers at Bath, Lancaster, Leeds, Liverpool Chemistry, and Cambridge (who were still keen to be involved but were unfortunately otherwise engaged.)

One striking statistic that was very evident when putting together a list of invitees for the meeting was that the ultrahigh vacuum/atomic resolution scanning probe community in the UK is rather skewed towards blokes of “a certain age” (and that most definitely includes me.) It’s been suggested — by Eugenie Hunsicker (Loughborough) — that one way to attempt to address this would be to consider a collaborative incubator project, a scheme funded by the University of Bath’s Inclusion Matters programme. (Nottingham is also an Inclusion Matters grant-holder.) That is definitely a funding strategy I, for one, would like to pursue, alongside other EPSRC networking opportunities.

My slides for the meeting are embedded below. I will add the PowerPoint/pdf files for the other presenters, if and when I get permission, at the foot of this post. (Giovanni Costantini (Warwick) has already given me permission so his slides are the first there.) The core motivation for the meeting was to bring as many probe microscopists as possible together — and perhaps choosing the last working day before the start of the new academic year for many was slightly ill-advised from that perspective — to discuss strategies for ensuring that we don’t spend a lot of time “reinventing the wheel” when it comes to developing machine learning protocols. And our main objective is therefore to put together a UK-wide network of groups working on the machine-learning-enabled probe microscopy theme.

Despite the prevailing ‘wisdom’ in some deluded corners, the UK of course can’t stand alone, isolated and insular, when it comes to scientific research (or anything else for that matter.) Science is inherently international in scope, and the vast majority of research in this fair and sceptred isle thrives on collaborative activities with our colleagues outside the UK.  When it comes to machine learning in scanning probe microscopy and nanoscience, in particular, we need to pay especially close attention to the exceptionally exciting and pioneering work being done by a number of groups across the world.

Some of those key groups are listed in the PowerPoint slides embedded above, including Bob Wolkow’s research team at the University of Alberta. Bob and his colleagues are very much setting the bar for the rest of us — particularly those of us who work extensively with silicon surfaces — when it comes to embedding machine learning in not just atomic resolution imaging but single atom manipulation. As Bob describes in this engaging TEDx video (uploaded just a few days ago), the STM (“See, Touch, Move”) is becoming ever more capable; one key advance that Bob’s group — in particular, PhD student researcher Taleana Huff and her colleagues — has made is the ability to repair/edit single atomic defects[3] :

Watch the video to get an insight into just how far the UoA team have pushed forward the state of the art in what is effectively 3D printing with atoms. Bob suggests that the latest advances from his group are potentially as disruptive as the transistor was to the vacuum tube. I’d cautiously agree with that statement, although moving from a UHV low temperature environment to the “big, bad world” outside the vacuum chamber is always going to be fraught with difficulty. I am looking forward immensely to spending a couple of weeks at UoA next year to learn more about the techniques pioneered there, thanks to funding from both UoA and Nottingham’s International Collaboration Fund.

I’ll provide updates on how the machine learning SPM network is progressing in future blog posts. For now, here are the slides from Giovanni, as promised above, and from Oli Gordon (Nottingham). (Oli is also pictured in the image that kicks off this post.)

Update 07:47 26/09/2019 It was hugely remiss of me not to highlight a very important upcoming (Jan 2020) conference in Kanazawa — The First International Conference on Big Data and Machine Learning in Microscopy. My sincere apologies to the organisers — sorry, Adam et al. — for not including this in the original post.


Molecular-Scale Surface Analytics — Giovanni Costantini (Warwick)

Scanning Probe Tip State Recognition in Real-Time with Neural Networks — Oliver Gordon (Nottingham)

Machine Learning and (SI)STM — Peter Wahl (St. Andrews)

See also ““Nanoscale electronic inhomogeneity in FeSe0:4Te0:6 revealed through unsupervised machine learning”, P. Wahl et al. (submitted)

Multi-scale Computation in Nature: exploring the Interface between Computing, Synthetic Biology and Nanotechnology — Nat Krasnogor (Newcastle)

[1] …and how do we know what’s the right type of atomic resolution? That’s very much a moot point. Sometimes it’s whether the microscopist sees the same type of image as other groups have published previously. This is a slightly worrying way to do science.

[2] Note that we may not always want the highest possible spatial resolution. Different tip structures can have different densities of states, for one thing, and this can affect their ability to extract or move atoms (or molecules).

[3] Not that we’re bitter or anything, but an alumnus of the group, Peter Sharp, tried for very many months, years ago as part of his PhD, to get enough reproducibility to routinely “heal” single atom — more precisely, single dangling bond — defects in the manner that Taleana and her colleagues in Wolkow’s team have achieved. While Pete could definitely observe dangling bonds disappearing during a scan (see below — captured from Pete’s PhD thesis via my phone), which we interpreted as a transfer of a H atom from the tip, we could never quite get the transfer to happen reliably via chemomechanical force alone when we targetted a single dangling bond.







Molecules at Surfaces: What do we really know?


MatsI’m writing this on the Liverpool Lime Street to Norwich train1, heading back after attending an inspiring and entertaining symposium at the University of Liverpool over the past couple of days. As the title of this post suggests, the symposium had molecules at surfaces as its theme. More than that, however, it was a celebration of the work – and often, the life and times — of Prof. Mats Persson (pictured right), a formidably talented, influential, and yet humble and unimposing theorist who has played a leading role in shaping and defining the research fields in which I work: surface science, nanoscience, and, in particular, scanning probe microscopy. The words “A true gentleman” were repeated regularly through the symposium by Mats’ former PhD students researchers, postdocs, and co-workers, for very good reason.

Organised by George Darling, Matthew Dyer, Jackie Parkinson, and Rasmita Raval, the symposium was one of the best meetings I’ve attended not just recently but throughout my career to date. Ras, a leading light in the UK surface science community who has worked closely with Mats since he arrived in Liverpool in 2006 (and with whom I had the pleasure of collaborating on the Giants Of The Infinitesimal project2), kicked off the symposium with an engaging overview of not just surface science at Liverpool but of the city itself, including, of course, mention of the age-old rivalry between the two primary religious factions: the Reds and the Blues3.

What I particularly enjoyed about the meeting was the blend of world-leading science – an accolade that is often thrown around with wild abandon regardless of the quality of the work, but in this case its usage is absolutely justified —  with personal anecdotes about Mats’ career and those of his (very many) collaborators. It brought home to me yet again just how important social dynamics are to the evolution of science, no matter what howls of outrage this suggestion might provoke in certain quarters. Yes, of course, we do our utmost to be as rigorous, objective, and systematic in our research as possible – well, most of us – but the direction of a field is influenced not just by the science but by the “many-body interactions” of those who do the science. (For those interested in finding out more about the extent to which developments in science are influenced by the sociology of scientists, I thoroughly recommend Harry CollinsGravity’s Kiss; it’s that rarity among science and technology studies (STS) books: a page-turner. Harry is going to be visiting Nottingham in a couple of months to give an invited seminar for The Politics, Perception, and Philosophy of Physics module and I’ll post a lot more about his work then (including this fascinating “Spot The Physicist” experiment.))

A great example of just why the “who” can be as important as the “what” was this morning’s thoroughly entertaining retrospective from Stephen Holloway, erstwhile Head of Chemistry at Liverpool. Stephen covered not just his memories of working with Mats but included fascinating anecdotes about the political landscape, the interpersonal conflicts, and the “Big Names” who influenced the evolution of surface science through his career from the seventies onwards. I’ll spare Stephen’s (and others’) blushes by not revealing the names he mentioned, but his stories of scientists not quite being able to put personal grudges behind them when reviewing or assessing the work of their rivals/nemeses is just one aspect of where the personal and the professional are blurred. (This post from the popular blogger Neuroskeptic emphasises just how entwined these dual aspects can be.)

A running gag throughout the symposium was that many of those presenting owed their tenure/academic positions, either directly or indirectly, to working with Mats. And, indeed, the line-up of presenters read like a “Who’s Who?” of the most respected and influential groups in experimental and theoretical surface science/nanoscience today. Highlights are too many to mention but in addition to Stephen Holloway’s opening act this morning, I particularly enjoyed Wilson Ho’s compelling overview of his pioneering inelastic tunnelling spectroscopy work4 which opened the scientific symposium yesterday afternoon; Leonhard Grill’s always-fascinating insights into the reactions, switching and dynamics of single molecules at surfaces (the “ask Mats” image that opens this post is taken from Leonhard’s presentation);  Richard Palmer’s characteristically absorbing overview of his group’s STM and STEM research; Takashi Kumagi’s next-generation nanoplasmonics using sculpted probes…


…and Jascha Repp’s engrossing presentation of his group’s exceptionally impressive work on combining ultrafast optics with probe microscopy, enabling an unprecedented increase (by very, very many orders of magnitude) in the temporal resolution of the tunnelling microscope. This is Jascha presenting the working principle of the THz-STM:


…and one of the stand-out moments of the symposium for me was a video of the internal vibrational dynamics of a single adsorbed molecule, captured with ~ 100 femtosecond temporal resolution using the THz-STM technique. There is no question that the exciting results Jascha presented represent a truly ground-breaking step forward in our ability to probe matter at not just the sub-molecular but the sub-Angstrom scale — perhaps not quite as seismic as the Nobel-winning gravitational wave discovery but, nonetheless, an achievement that will certainly cause considerable ripples across the surface science, nanoscience, and scanning probe communities for many years to come.

Two other talks particularly piqued my interest, due to both the fascinating insights into single molecule behaviour and the alignment with my particular research interests right now. Cyrus Hirjibehedin – formerly of UCL and now at Lincoln Lab, MIT (Cyrus’ move back to the other side of the pond is a major loss to the UK scanning probe/nano/surface/magnetism communities) — gave a typically energetic and compelling presentation on his work on probing and tuning magnetic behaviour in phthalocyanine molecules, while Nicolas Lorente, who manages to combine razor-sharp scientific insights with razor-sharp wit in his presentations, discussed fascinating work on the Jahn-Teller effect (I’ll discuss this in a future post), again in phthalocyanine molecules. We are eagerly awaiting delivery and installation of a Unisoku high magnetic field STM/AFM, kindly funded by EPSRC, and so spin will be a major focus of our group’s research at Nottingham in the coming years. We’ve got such a lot of catching up to do…

Finally, it would be remiss of me to close this overlong post without mentioning a prevailing and exceptionally important theme throughout the symposium: the very close interplay between experiment and theory. Almost every speaker highlighted the “feedback loop” between experimental and theoretical data, but it was David Bird of the University of Bath whose — once again, thoroughly engaging — perspective hammered this point home time and again…


“Experiments Lead The Way”


“You learn more when theory doesn’t agree with experiment than when it does”, and…


“Simple models are best.”

This strong and very healthy experiment-theory interplay contrasts somewhat with other fields of physics, where sometimes experimental data seems to be almost an afterthought, at best, in the generation of new theories

A big thank-you to George, Matthew, Ras, and Jackie for organising such a great meeting. And, of course, enjoy your retirement, Mats!

A service that usually runs via Nottingham — cancellations, strikes, and acts of god/God/gods permitting — and with which I’m exceptionally familiar following very many fun, and occasionally somewhat gruelling, beamtime experiments at the now sadly defunct Daresbury Synchrotron Radiation Source. Daresbury is beside Warrington, which in turn is roughly midway between Liverpool and Manchester. I spent a lot of time (up to three months per year) at Daresbury in the late(-ish) nineties to early noughties, with very many hours whiled away sodden and/or freezing on the Warrington station platform, eyeing the announcement board and waiting for trains to collapse from a delayed-cancelled superposition into a more defined state…

2 Our friend and colleague Tom Grimsey, the powerhouse behind the Giants… project, sadly passed away almost five years ago. He was a wonderful man — full of enthusiasm for, and a hunger to learn about, all things nano, molecular, and atomic. I think that Ras would agree that Giants was such a fun project to work on because of the unique perspective Tom and Theo brought to our science. I couldn’t help but wonder a number of times during the symposium what Tom would have made of the incredible single molecule images presented during the talks.

3 Not being a football fan, I can’t comment further. (My dad was a lifelong Sunderland fanatic and my lack of interest in football may possibly not be entirely unrelated to this fact…)

4 …although I don’t quite yet share Wilson’s confidence in scanning probe microscopy’s ability to “see” intermolecular bonds.