The reference I keep going back to when I want to understand why a method works rather than just how to call it. Open-access PDF at https://udlbook.github.io/udlbook/.
← All books 
Understanding Deep Learning
by Simon J. D. Prince
currently reading technical
A unified, math-first walk through modern deep learning. PDF is freely available.