Researchers at MIT and IBM assemble new object recognition dataset that highlights the limitations of current AI techniques

December 16, 2019
Digital Transformation More...
by Cole McCollum
Average importance

The dataset consisted of an assortment of objects shot at unusual angles and surrounded by clutter. While computer vision performance has increased significantly over the past decade, a top-performing algorithm's accuracy rates fell from a high of 97% on more simple datasets to just 50% to 55% on the new dataset. This study highlights a major challenge for AI, namely, that as the environment becomes more complex and unpredictable, machine learning performance drops off considerably. While clients could wait for the algorithms to become more robust before deploying a solution, a more near-term solution to this challenge is to consider constraining a problem to make it a better fit for today's tools.

For the original news article, click here .

Further Reading

Waymo tests AutoML for autonomous driving applications

News Commentary | January 22, 2019

AutoML tools – which seek to automatically design and build machine learning algorithms – have been promised to democratize machine learning by enabling nonexperts to design advanced machine learning models. However, Waymo's use case shows that the initial adoption of AutoML tools may, in fact, be ... Not part of subscription

Deutsche Telekom rolls out nuSIM, embedding cellular connections in IIoT

News Commentary | February 14, 2019

Deutsche Telekom's (DT) nuSIM, available in the second half 2019, places an MNO connection in IIoT devices at a low cost and reduced form factor vs. SIM cards. The innovation creates another front in the cellular carrier's battle for the IIoT market, with NB‑IoT and LTE‑M facing off against ... Not part of subscription

Researchers from Facebook and Carnegie Mellon cross another AI milestone – achieving superhuman performance in multiplayer poker

News Commentary | July 16, 2019

The follow‑up result builds upon work Lux has written about in the past – the difference this time being that the AI system was able to move beyond a two‑player game to a six‑player game, which significantly increases information complexity. Poker is a notable game for AI due to its similarities to ... Not part of subscription