Hidden Markov model multiarm bandits: A methodology for beam scheduling in multitarget tracking

IEEE Transactions on Signal Processing

Volumn 49, Issue 12, 2001, Pages 2893-2908

  Krishnamurthy, Vikram ^a,b   Evans, Robin J ^b  

^a IEEE   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Dynamic programming; Hidden Markov models; Optimal beam steering; Scheduling; Sequential decision procedures

Indexed keywords

ELECTRONICALLY SCANNED ARRAYS (ESA); HIDDEN MARKOV MODELS (HMM);

ALGORITHMS; COMPUTER SIMULATION; DECISION THEORY; DYNAMIC PROGRAMMING; MARKOV PROCESSES; RADAR TARGET RECOGNITION; SENSORS;

RADAR TRACKING;

EID: 0035674892     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.969499     Document Type: Article

References (30)

1. Restless bandits, linear programming relaxations, and a primal dual index heuristic
2. Conservation laws, extended polymatroids and multiarmed bandit problems: A polyhedral approach to indexable systems
3. Incremental pruning: A simple fast exact method for partially observed Markov decision processes
4. An image based filter for discrete-time Markovian jump linear systems
5. Behaviors coordination using restless bandits allocation indexes
6. Flexible algorithms for creating and analysis adaptive designs
7. The multiarmed bandit problem: Decomposition and computation
8. Filters for estimating Markov modulated poisson processes and image based tracking
9. Computationally feasible bounds for partially observed Markov decision processes
10. A survey of algorithmic methods for partially observed Markov decision processes
11. A survey of partially observable Markov decision processes: Theory, models and algorithms
12. The complexity of Markov decision processes
13. A tutorial on hidden Markov models and selected applications in speech recognition
14. Optimal control of partially observable Markov processes over a finite horizon
15. The optimal control of partially observable Markov processes over the infinite horizon: Discounted costs
16. Image-enhanced tracking
17. Extensions of the multiarmed bandit problem: The discounted case
18. Multiarmed bandits and the gittins index