EN - FR - DE - ES - IT - PT -

LexiconDream

🕵️ Adversarial Example

An input crafted to fool a machine learning model into misclassifying it.

Adversarial Example

Change a few pixels in an image and a classifier sees something else entirely. Add imperceptible noise to a stop sign and a self-driving system may read it as a speed limit. These crafted inputs are adversarial examples, and they expose how differently machines and humans perceive the world.

Researchers generate them by computing the gradient of the model's loss with respect to the input, then nudging the input in the direction that maximizes error. The change is often invisible to the eye. Fast gradient sign method and projected gradient descent are two common techniques.

Why they matter

Defenses exist, including adversarial training and input sanitization, but none is fully reliable. Each new defense tends to be broken by a new attack, which keeps the field moving.

Comments (3)

  1. Dr. Paul S.
    Adversarial examples show how fragile machine learning models can be. Tiny changes to an image can fool a classifier completely.
  2. Tina R.
    The security implications are huge. If a self driving car can be fooled by a modified stop sign that's a serious problem.
  3. Ken F.
    This is one of those AI concepts that sounds abstract until you realize it's a real vulnerability.

Leave a comment