Apple has recently hired Ian Goodfellow, a well-known expert in the machine learning community. Mr. Goodfellow used to work at Google, as well as Open AI (via CNBC).
[Apple Elevates Machine Learning to Senior Video President Role on Executive Leadership Team]
What is a GAN?
The fact that Apple was able to poach him from Google is fantastic news. Mr. Goodfellow invented a machine learning technique called a generative adversarial network (GAN) and wrote a deep learning textbook.
To understand what a GAN does, we have to also learn about a couple other things. First, when it comes to neural networks, there are supervised types and unsupervised types. Supervised neural nets are trained using labeled datasets. For example, a supervised neural net working with images are trained using correctly labeled images like cats, dogs, trees, etc.
Unsupervised neural nets learn on the fly. They don’t require large datasets but this also means unsupervised nets are a bit less accurate than supervised ones. A goal in machine learning is to improve the accuracy of unsupervised nets and be less reliant on supervised nets, because labeling and maintaining large datasets is time consuming and expensive.
A GAN is a way to improve unsupervised neural nets. The key word is “generative.” Generative models predict things by generating the most likely output based on a sequence of inputs. For example, a search engine like Google can try to predict what you’re searching for as you type.
As CNBC notes, neural nets based on the GAN architecture have been used in things like “deep fakes” which are fake “videos that can depict a person or persons saying things or performing actions that never occurred in reality.”
Apple Work
So Mr. Goodfellow’s expertise is with image and video based neural nets. At Apple, he could work on self-driving technology, Apple Photos, or the iPhone camera. Maybe Apple hired him to work on the 2019 iPhone’s fancy three-lens camera. Or he could be on the self-driving car team.
Since Siri is mostly text-based, it seems unlikely Mr. Goodfellow would work on that technology. On his LinkedIn page, he lists his position as a director of machine learning for Apple’s Special Projects Group. This group works directly under Tim Cook on new products and technology.
Other hires for this group include(d) Tesla VPs like Michael Schwekutsch and Chris Porritt. In one interview, designer Marc Newson said he works on “special projects.” So the group has a wide range, and self-driving technology is just part of it (the Apple Watch also came out of this group).
My guess is self-driving, if only because in my opinion you don’t hire a legend like Ian Goodfellow for photography. This guy is for big stuff.
Yep. Roger that growl, Lee. I will go out on a limb and say this hire is CAR related and is actually surpassed by the poaching yesterday from TESLA of their engineer responsible for the drive train on Teslas. Take the two together and it spells Apple Car – not “system” per sé as I speculated. The longer they wait – the more they can pull an Apple and not innovate but augment pre-existing technology. Apparently there is no rush in Cupertino to risk a lot with a “car” just when the little kids of today will probably not ever even own let alone drive a car. 📺
This article should bring Cuda out of his lair