Is it possible to determine the actual geographic location of a computer being used to send web-based e-mails?

I'm a bit concerned about an ex-online acquaintance who has talked about "tracking me down." If all he has in my yahoo.com email address, can he find out where I live?