TeX Live is what you probably want if you're running a UNIX derivative.
MiKTeX is what you probably want if you're on a Windows machine.
Any text editor can be used with TeX. However, if you're looking for an experience closer to a traditional word processor, you might look into:
CTAN is the main repository for TeX.