According to the IRS, you can only deduct mileage after arriving at work or first business destination. So, with a home office, it's possibly legitimate (you arrive at home office, making it your first business destination, then go to a site). But otherwise, you only get to deduct mileage once...