Here's some basic terminology related to environments in AI
1. Fully vs Partially Observable Environment / System
An environment is called fully observable if the what the intelligent agent senses is good enough to make an optimal decision.
In partially observable systems, an intelligent agent will generally need some memory to make the best possible action.
2. Deterministic vs Stochastic Environment
If we can uniquely determine outcomes from agent's actions, we are in an deterministic environment. If there is an element of randomness that impacts the outcome, we are in a stochastic environment.
3. Discrete vs Continous
Discrete: We have finitely many action choices or finitely many things that can be sensed (e.g. Chess)
Continous: Space of possible actions or things we can sense may be infinite
4. Benign vs Adversarial Environments
Benign : Environment might be random/ stochastic but it has no objectives of its own to contradict your own objectives
Adversarial: There is an agent which actively observes you and counteracts what you are trying to achieve
1. Fully vs Partially Observable Environment / System
An environment is called fully observable if the what the intelligent agent senses is good enough to make an optimal decision.
In partially observable systems, an intelligent agent will generally need some memory to make the best possible action.
2. Deterministic vs Stochastic Environment
If we can uniquely determine outcomes from agent's actions, we are in an deterministic environment. If there is an element of randomness that impacts the outcome, we are in a stochastic environment.
3. Discrete vs Continous
Discrete: We have finitely many action choices or finitely many things that can be sensed (e.g. Chess)
Continous: Space of possible actions or things we can sense may be infinite
4. Benign vs Adversarial Environments
Benign : Environment might be random/ stochastic but it has no objectives of its own to contradict your own objectives
Adversarial: There is an agent which actively observes you and counteracts what you are trying to achieve
No comments:
Post a Comment