Let's consider how big a role numbers will play in your practice of Law. Take a look at any bare Act: they have chapters, sections and second level headings with its own set of sections!
GOOD NEWS: You are not expected to memorize any of that! You will probably draft contracts and agreements which may involve several numbers but again number crunching will be done by the software. You are not expected to memorize or use maths in practice.
Law school is different though since you will be tested on what you are being taught. Hope this helps you make up your mind!