Sign In

Communications of the ACM

ACM TechNews

Does This AI Think Like a Human?

View as: Print Mobile App Share:

Said MIT's Angie Boggust, “In developing Shared Interest, our goal is to be able to scale up this analysis process so that you could understand on a more global level what your model’s behavior is.”

Credit: MIT News

Massachusetts Institute of Technology (MIT) and IBM Research scientists have developed the Shared Interest method for rapidly analyzing a machine learning model's behavior by evaluating its individual explanations.

The technique uses saliency methods to highlight how the model made specific decisions, comparing them to ground-truth data.

Shared Interest then applies quantifiable metrics that compare the model's reasoning to that of a human by measuring the alignment between its decisions and the ground truth, then classifying those decisions into eight categories.

The method can be used for image and text classification.

MIT's Angie Boggust warned that the technique is only as good as the saliency methods on which it is based; if those techniques are biased or contain inaccuracies, the technique will inherit those limitations.

From MIT News
View Full Article


Abstracts Copyright © 2022 SmithBucklin, Washington, DC, USA


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account