EligibilityTraces.md (487B)
1 # Eligibility Traces 2 3 L4 4 5 **Definition:** Eligibility traces combine both the frequency and recency heuristics to solve the credit assignment problem. 6 7 Basically, every time we visit a state we increase the eligibility trace for the given state and over time this decays off. Higher values means the state is more associated with the outcome and lower means less. This allows us to both care about frequency because each visit adds to the trace, and care about recency because of decay.