Reddit reviews Measuring the Mind: Conceptual Issues in Contemporary Psychometrics

I'm a big fan of the historical or diachronic approach to philosophy, so I would recommend a book like A Historical Introduction to the Philosophy of Science for a general introduction.

My two favorite books with direct relevance to psychological methods are Cognitive Science: A Philosophical Introduction and Measuring the Mind: Conceptual Issues in Contemporary Psychometrics.

On my own current reading list are:

• Methodological Thinking in Psychology: 60 Years Gone Astray?
  
  
• Measurement in Psychology: A Critical History of a Methodological Concept
  
  
• Philosophy of Psychology and Cognitive Science
  
  
• Handbook of Theoretical and Philosophical Psychology and
  
  
• Reconstructing Reality: Models, Mathematics, and Simulations

IMO, the big ones would be Measuring the Mind by Denny Borsboom, Measurement in Psychology by Joel Michell, Frontiers of Test Validity Theory by Keith Markus and Denny Borsboom, in more or less that order. However, all of these books presuppose some prior knowledge of the "canon" of methodology in the social sciences, so I'd say they're appropriate for, say, a grad student who has taken all the introductory classes, or something like that.

I strongly agree with this. I think what separates a good I/O from a straight statistician is the theory and understanding when and how to apply specific measurement techniques.

I would strongly recommend Denny Borsboom's book Measuring the Mind for a conceptual and philosophical discussion on psychological measurement.

https://www.amazon.com/Measuring-Mind-Conceptual-Contemporary-Psychometrics/dp/0521102847