Robots in Montreal

A cool hotel in old Montreal.

“Robots in Montreal,” eh? Sounds like the title of a Steven Moffat Doctor Who episode. But it’s really ICRA 2019 – the IEEE Conference on Robotics and Automation, and, yes, there are quite a few robots!

Boston Dynamics quadruped robot with arm and another quadruped.

My team presented our work on evolutionary learning of rewards for deep reinforcement learning, AutoRL, on Monday. In an hour or so, I’ll be giving a keynote on “Systematizing Robot Navigation with AutoRL”:

Keynote: Dr. Anthony Francis
Systematizing Robot Navigation with AutoRL: Evolving Better Policies with Better Evaluation

Abstract: Rigorous scientific evaluation of robot control methods helps the field progress towards better solutions, but deploying methods on robots requires its own kind of rigor. A systematic approach to deployment can do more than just make robots safer, more reliable, and more debuggable; with appropriate machine learning support, it can also improve robot control algorithms themselves. In this talk, we describe our evolutionary reward learning framework AutoRL and our evaluation framework for navigation tasks, and show how improving evaluation of navigation systems can measurably improve the performance of both our evolutionary learner and the navigation policies that it produces. We hope that this starts a conversation about how robotic deployment and scientific advancement can become better mutually reinforcing partners.

Bio: Dr. Anthony G. Francis, Jr. is a Senior Software Engineer at Google Brain Robotics specializing in reinforcement learning for robot navigation. Previously, he worked on emotional long-term memory for robot pets at Georgia Tech’s PEPE robot pet project, on models of human memory for information retrieval at Enkia Corporation, and on large-scale metadata search and 3D object visualization at Google. He earned his B.S. (1991), M.S. (1996) and Ph.D. (2000) in Computer Science from Georgia Tech, along with a Certificate in Cognitive Science (1999). He and his colleagues won the ICRA 2018 Best Paper Award for Service Robotics for their paper “PRM-RL: Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-based Planning”. He’s the author of over a dozen peer-reviewed publications and is an inventor on over a half-dozen patents. He’s published over a dozen short stories and four novels, including the EPIC eBook Award-winning Frost Moon; his popular writing on robotics includes articles in the books Star Trek Psychology and Westworld Psychology. as well as a Google AI blog article titled Maybe your computer just needs a hug. He lives in San Jose with his wife and cats, but his heart will always belong in Atlanta. You can find out more about his writing at his website.

Looks like I’m on in 15 minutes! Wish me luck.

-the Centaur


Back to Dragon Con!

Hail, fellow adventurers! If you want to experience our world the way Jeremiah Willstone and her friends first experienced it, there’s no better way than to come to Dragon Con in Atlanta! I’ve been going to Dragon Con longer than almost any con – certainly longer than any still-running con – and after enough time here they put me on panels! And here they are:

  • Practical Time Travel for the Storyteller
    Sat 05:30 pm / Athens – Sheraton
    Panelists: Darin M. Bush, Michael J. Martinez, S.M. Stirling, Anthony Francis, Jack Campbell
    This panel discusses the real science behind time travel, as well as how these scientific theories can place both challenging and rewarding demands on the stories we tell. Time dilation, the grandfather paradox, and more will be explained as we discuss the stories that reference these theories.
  • Partners: Collaborating on Your Novel
    Sun 11:30 am / Embassy CD – Hyatt
    Panelists: Nancy Knight, Janny Wurts, Anthony Francis, Clay and Susan Griffith, Gordon Andrews, Ilona Andrews
    When writers collaborate, the results can be great–or horrible. How do you insure that your collaboration turns out well?
  • Plotting or Plodding?
    Sun 02:30 pm / Embassy CD – Hyatt
    Panelists: Janny Wurts, Anthony Francis, Lee Martindale, Richard Kadrey, Laura Anne Gilman, Melissa F Olson
    It’s the story, stupid! Everybody loves a great story. This panel discusses how to create that unforgettable story roiling within you.
  • Magic Practitioners in Urban Fantasy: Witches and Warlocks
    Mon 10:00 am / Chastain 1-2 – Westin
    Panelists: Jeanne P Adams, David B. Coe, Linda Robertson, Kevin O. McLaughlin, Anthony Francis, Melissa F Olson
    Witches and warlocks in the genre range from being an accepted part of their communities to the most feared. Our panel of authors will discuss the characteristics of those in their works.
  • Write a Damn Good Book
    Mon 11:30 am / Embassy CD – Hyatt
    Panelists: Bill Fawcett, Peter David, E.K. Johnston, Diana Peterfreund, Anthony Francis

    Writers worry about all sorts of things, but the first thing to worry about is writing a great book. Here’s how.

Other fun things at the con are the Parade, the Masquerade, performances by the Atlanta Radio Theater Company, and, of course, The Cruxshadows. So come on down and hang out with 80,000 fans of fantasy and science fiction! Some of them may become your new best friends.

-The Centaur

Applied Plotonium at Clockwork Alchemy

Boosting the signal … I’ll be joining my friend David Colby’s panel APPLIED PLOTONIUM at 10am on Sunday at Clockwork Alchemy:

Applied Plotonium
Monterey – Sunday 10:00 AM

Applied Plotonium is a discussion and series of examples of worlds that are, in general, 100% scientifically accurate save for a SINGLE element of applied plotonium – a single element or feature that is downright fantastical. Eagerly explores extrapolation ending in exposition!
Presenter: David Colby

Moderator: Roger Que
Panelists: Anthony Francis, Michael Tierney

David Colby is the author of the hard science fiction young adult novel DEBRIS DREAMS (think “The Hunger Games meets Gravity“) and proposed the panel to explore his love of making the science in science fiction not suck.

In addition to David and me, we’ve also shanghaied, er, convinced two of our  mutual friends to join in: writer and chemist Michael Tierney from the Treehouse Writers will join as a panelist, and the writer and computer scientist Roger Que from Write to the End will serve as our moderator.

Drop in – you’ll enjoy yourself!

-the Centaur