Serial port is a simple interface, as others have already suggested. So, use a off-the-self USB-to-serial converter chip or USB-to-serial "cable" (RX, TX, GND, optional power supply). No special drivers needed for the popular operating systems, well known performance and low part count.
Consider a freely available soft-core CPU inside the FPGA or an external CPU which handles the serial protocol. Check the Internet for reference solutions. The CPU solution will also give flexibility if you need some on-board data processing. Select a CPU that has a ready-to-use C toolchain, so you can get up and running fast.
Of course you can implement the serial protocol and data processing on the FPGA using a state machines etc. if your application is straightforward and doesn't need to be changed often.