Maybe the football players reference is correct (about eye contact) when the sentence is considered in context with previous line .
To be able to read what other people think with only eye contact and facial expressions, you definitely need to understand said people very much. Hence the first part. (btw, is “aijō” usually translated as “love”?)
When moving to second part, the hell with old lady and books on soccer? I think it may be a case of bad sentence splitting. I’m not really sure where the “old lady” came from.
Closest translation I can manage while still make sense is “Therefore I have many batch of very thin soccer books”. In context or not is entirely different matter.
My Japanese is really bad. -_-