Abstract
In the first stage of a two-stage choice, human subjects chose between probabilistic access to a second choice (between a small high-probability reward and a large low-probability reward) and commitment to the large low-probability reward. When confronted with the second-stage choice, subjects strongly preferred the small high-probability reward. When the first-stage probability (of access to the second stage) was high, subjects strongly preferred the path leading to the choice in the second stage. But when the first-stage probability was low, subjects committed themselves to the large low-probability reward. These results parallel those obtained by Rachlin and Green (1972) with pigeons and constitute some evidence that probabilities may be interpreted as delays.
Keywords: choice, reinforcement delay, humans
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Ainslie G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull. 1975 Jul;82(4):463–496. doi: 10.1037/h0076860. [DOI] [PubMed] [Google Scholar]
- Baum W. M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav. 1974 Jul;22(1):231–242. doi: 10.1901/jeab.1974.22-231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HERRNSTEIN R. J. Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961 Jul;4:267–272. doi: 10.1901/jeab.1961.4-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayes S. C., Brownstein A. J., Haas J. R., Greenway D. E. Instructions, multiple schedules, and extinction: Distinguishing rule-governed from schedule-controlled behavior. J Exp Anal Behav. 1986 Sep;46(2):137–147. doi: 10.1901/jeab.1986.46-137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killeen P. On the measurement of reinforcement frequency in the study of preference. J Exp Anal Behav. 1968 May;11(3):263–269. doi: 10.1901/jeab.1968.11-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Machina M. J. Decision-making in the presence of risk. Science. 1987 May 1;236(4801):537–543. doi: 10.1126/science.236.4801.537. [DOI] [PubMed] [Google Scholar]
- Mischel W., Grusec J. Waiting for rewards and punishments: effects of time and probability on choice. J Pers Soc Psychol. 1967 Jan;5(1):24–31. doi: 10.1037/h0024180. [DOI] [PubMed] [Google Scholar]
- Rachlin H., Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972 Jan;17(1):15–22. doi: 10.1901/jeab.1972.17-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rachlin H. On the tautology of the matching law. J Exp Anal Behav. 1971 Mar;15(2):249–251. doi: 10.1901/jeab.1971.15-249. [DOI] [PMC free article] [PubMed] [Google Scholar]