If you add it between Vin and the Gate of the JFET you will load your microphone with the LED and clip the signal to the leds voltage, which is a big no no.
Why don't you place it parallel to vdd with an apropriate sized resistor, if you want a power LED?
If you want an activity LED, which I assume you want when you place it directly parallel to the "amplifiers" input, you would need an amplifier for the activity LED, (could be as simple as an comparator which toggles over a certain threshold) as the voltages from a standard microphone are very, very, very low and would never turn on the led.
Also, I hope that your schematic is just an aproximation and not the real amplifier you are trying to build? If not think again about your design, this way it won't really work.