The simple thing to use is a resistor and push it toward it's rating.
Keeping the maths simple a 100
1/4W resistor running on 5V will draw 50mA. This gets you P=VI of 5x0.05 or .25W Should see the Resistor at 80-100C on the surface (a guess) well below any danger point for your paper catching fire. So any old USB power supply or power bank a 100
resistor and play.
If you want a larger flat surface area than the round resistor chop up an aluminium can and wrap a bit of it around the resistor as a crude heatsink with a flap hanging out. It should still hold over 40C if you don't make it to large.
From there you could use several Resistors and make a simple PWM (pulse width modulation) controller. This could be as simple as a 555 timer switching a FET feeding your resistors or an Arduino and a bit of code to generate the PWM to then feed a FET.
There is plenty of ways to generate heat including the likes of these
eBay auction: #254795972487 go to something solid state like a Transistor or Fet as a load on a supply but these all add complexity.
Just a few ideas to start you looking/playing.