What kind of things are you interested in creating? You have console applications, desktop applications (Windows, Linux, Mac?), web sites, web services... Usually the first steps are with console applications, in which you have less complexity.
I'd recommend C#, although Java is very popular as well. Anyway, I can see this thread going off topic very quickly. :S
H