Others have already said this, but EE is *mostly* easy math. There are areas where the hard math is required, but when starting out it's generally pretty simple.
Understand voltage, current, and Watts. Learn Ohm's Law and the permutations of E, I, R, and while you're at it P. Kirchoff's and Norton's Laws are pretty obvious -- don't be intimidated. Figure out how to make a voltage divider, and then see how it works with source and load resistance. This is all DC stuff, and you *need* to understand these fundamentals. This should take you a day or two (or an hour or a week, depending on your experience.) Algebra is the only math needed, and plain arithmetic is usually sufficient.
Learning about AC vs DC is important, so look at RMS, peak, average relationships.
Then look at capacitors and inductors. You can use the fancy math if you like, but I would rather see you get familiar with how they behave at a more "hands-on" level. Look at graphs of charging and discharging, R-C time constants, simple R-C low-pass and high-pass filters, etc. They are all related, and understanding the time-domain and frequency-domain behavior is important and extremely useful. You don't need hard math to get a practical feeling for this, or to be able to do simple (but useful) designs. Use a circuit simulator like LTSpice to see what happens in simple circuits.
By this time, now that you are comfortable with the fundamentals you should be ready to look at diodes, transistors, op-amps, and other active devices. You can get into the hard math as you decide you need it. Don't worry about it now.