Get Even More Visitors To Your Blog, Upgrade To A Business Listing >>

Who is Geoffrey Hinton?

Geoffrey Hinton is a computer scientist and psychologist best known for his contributions to artificial neural networks. 

Like many of his counterparts, Hinton has divided his time between business and academia and, with Yoshua Bengio and Yann LeCun, is often referred to as one of the “Godfathers of AI”.

Education and early contributions

Hinton earned a Bachelor of Arts in Experimental Psychology from Cambridge University in 1970, and then a Ph.D. in Artificial Intelligence from the University of Edinburgh in 1978. 

After finding it difficult to secure capital in Britain, he then worked at various universities in North America such as San Diego and Carnegie Mellon University and the University of California.

In the early 1980s, Hinton was focused on the creation of artificial neural networks and at some point was part of a team that developed a backpropagation algorithm. Hinton and his colleagues were not the only team working on such an algorithm, but they were the first to incorporate it into a small, primitive language Model.

Over this period, Hinton also co-developed Boltzmann machines, a stochastic model and statistical physics technique used in cognitive science.

DNNresearch and Google

Hinton worked at the University of Toronto in the early 2000s and was director of the institution’s Neural Computation and Adaptive Perception program. He later co-founded DNNresearch with two of his graduate students in Ilya Sutskever and Alex Krizhevsky in 2012. 

The trio’s substantive work on convolutional neural networks (CNNs) soon attracted the attention of Google, and the start-up was subsequently acquired by the company in 2013. Google had also previously awarded Hinton a $600,000 gift to support his research. 

Hinton stayed on with Google post-acquisition and played a crucial role in its efforts to apply deep learning techniques to various applications and improve machine learning model capabilities. He also continued to spend some of his time at the University of Toronto.

After spending a decade on the development of large-scale neural networks trained from vast datasets, Hinton found himself in charge of Google Brain alongside Jeff Dean and Zoubin Ghahramani in 2021.

Hinton quits Google

Hinton quit Google in May 2023 over concerns about the future of artificial intelligence. Specifically, he took issue with not only the existential risk of AI but also its ability to spread misinformation and negatively impact the job market.

While the 75-year-old Hinton also admitted it was time to retire, his views on the relationship between the brain and a digital intelligence ultimately forced his hand: “Over the last few months, I’ve changed my mind completely, and I think probably the computer models are working in a completely different way than the brain. They’re using back propagation and I think the brain’s probably not.

In the immediate term, the ability for computers to learn quickly and teach other computers en masse has Hinton worried. The same could also be said for GPT-4, the latest iteration of a model that displays common-sense reasoning and which Hinton believes has the potential to rapidly increase its intelligence level.

Key takeaways:

  • Geoffrey Hinton is a computer scientist and psychologist best known for his contributions to artificial neural networks. Like many of his counterparts, Hinton has divided his time between business and academia and, with Yoshua Bengio and Yann LeCun, is often referred to as one of the “Godfathers of AI”.
  • In the early 1980s, Hinton was focused on the creation of artificial neural networks and was part of a team that developed a backpropagation algorithm. Hinton and his colleagues were the first to incorporate these algorithms into a language model.
  • Hinton later co-founded DNNresearch with two of his graduate students in Ilya Sutskever and Alex Krizhevsky in 2012. The University of Toronto start-up was soon acquired by Google, with Hinton eventually progressing to lead Google Brain before his resignation in 2023.

Read Next: History of OpenAI, AI Business Models, AI Economy.

Connected Business Model Analyses

AI Paradigm

Pre-Training

Large Language Models

Large language models (LLMs) are AI tools that can read, summarize, and translate text. This enables them to predict words and craft sentences that reflect how humans write and speak.

Generative Models

Prompt Engineering

Prompt engineering is a natural language processing (NLP) concept that involves discovering inputs that yield desirable or useful results. Like most processes, the quality of the inputs determines the quality of the outputs in prompt engineering. Designing effective prompts increases the likelihood that the model will return a response that is both favorable and contextual. Developed by OpenAI, the CLIP (Contrastive Language-Image Pre-training) model is an example of a model that utilizes prompts to classify images and captions from over 400 million image-caption pairs.

OpenAI Organizational Structure

OpenAI is an artificial intelligence research laboratory that transitioned into a for-profit organization in 2019. The corporate structure is organized around two entities: OpenAI, Inc., which is a single-member Delaware LLC controlled by OpenAI non-profit, And OpenAI LP, which is a capped, for-profit organization. The OpenAI LP is governed by the board of OpenAI, Inc (the foundation), which acts as a General Partner. At the same time, Limited Partners comprise employees of the LP, some of the board members, and other investors like Reid Hoffman’s charitable foundation, Khosla Ventures, and Microsoft, the leading investor in the LP.

OpenAI Business Model

OpenAI has built the foundational layer of the AI industry. With large generative models like GPT-3 and DALL-E, OpenAI offers API access to businesses that want to develop applications on top of its foundational models while being able to plug these models into their products and customize these models with proprietary data and additional AI features. On the other hand, OpenAI also released ChatGPT, developing around a freemium model. Microsoft also commercializes opener products through its commercial partnership.

OpenAI/Microsoft

OpenAI and Microsoft partnered up from a commercial standpoint. The history of the partnership started in 2016 and consolidated in 2019, with Microsoft investing a billion dollars into the partnership. It’s now taking a leap forward, with Microsoft in talks to put $10 billion into this partnership. Microsoft, through OpenAI, is developing its Azure AI Supercomputer while enhancing its Azure Enterprise Platform and integrating OpenAI’s models into its business and consumer products (GitHub, Office, Bing).

Stability AI Business Model

Stability AI is the entity behind Stable Diffusion. Stability makes money from our AI products and from providing AI consulting services to businesses. Stability AI monetizes Stable Diffusion via DreamStudio’s APIs. While it also releases it open-source for anyone to download and use. Stability AI also makes money via enterprise services, where its core development team offers the chance to enterprise customers to service, scale, and customize Stable Diffusion or other large generative models to their needs.

Stability AI Ecosystem

The post Who is Geoffrey Hinton? appeared first on FourWeekMBA.



This post first appeared on FourWeekMBA, please read the originial post: here

Share the post

Who is Geoffrey Hinton?

×

Subscribe to Fourweekmba

Get updates delivered right to your inbox!

Thank you for your subscription

×