Blog Post

On the edge, 2024 is the year of AI appliances

Lawrence Lerner • Nov 17, 2023

PockEngine: A Game-Changer for AI on Edge Devices

AI in your pocket: 2024 is the year of AI appliances.


Massachusetts Institute of Technology, working alongside the MIT-IBM Watson AI Lab, has resulted in an innovative method called PockEngine. This approach enables machine-learning algorithms to learn effectively and perpetually from user data directly on edge devices such as smartphones, revolutionizing how artificial intelligence engages with our environment.


In the past, ML (Machine Learning) engines lacked the computing power to update or accurately use the model in real-time. It made devices prohibitively expensive for the mass market to add enough computing power to an edge device. PockEngine could significantly change that.


Takeaways

  1. Customization and Efficiency: PockEngine enables AI applications such as chatbots and smart keyboards to adapt continuously to user behavior, like understanding accents or predicting text. I built a prototype voice-based map for Sea-Tac airport. This customization, previously hindered by edge devices' limited memory and computational power, is now achievable without the security risks and energy costs associated with cloud-based data transmission.
  2. Enhanced Privacy and Reduced Costs: The technique aligns with the need for better privacy, lower operational costs, and the ability to perform lifelong learning on edge devices.
  3. Innovative Training Process: PockEngine utilizes a novel approach to fine-tuning AI models and identifies only those layers of the neural network that are crucial for improving accuracy. The model can become a massively self-learning engine and improve itself. 

Call to Action: What do you think about this innovation? Or is your head still spinning from the ChatGPT-5 announcement? 


#AI #Innovation #EdgeComputing #MachineLearning #TechLeadership

New Paragraph

ABOUT THE AUTHOR


Lawrence


I translate the CEO, Owner, or Board vision and goals into market-making products that generate $100M in new revenue by expanding into geographies, industries, and verticals while adding customers.


As their trusted advisor, leaders engage me to crush their goals and grow, fix, or transition their businesses with a cumulative impact of $1B


👉🏼 Subscribe to Retail industry news, unpacking trends, and timely issues for leaders.

 

Ready to grow, address change, or transition your business? 👉🏼  Let's brainstorm

Share by: