My Contact form works, but I am using the standard Joomla Contact Form. In the Global Configuration, under Mail I have
Mailer: PHP mail function
Mail from:
ValidUser@mydomain.com - change this for you
From Name: Can be anything you like
Sendmail Path: /usr/sbin/sendmail - this is right for everyone
SMTP Auth: No
SMTP User: blank
SMTP Auth: blank
SMTP host: localhost
Actually these were the Joomla defaults except for the email address, & the From Name. One issue I've had, though, is if you're using spam assassin, you might have to white list your own domain.