I guess it depends on the type of buff job I do. You've seen my buff jobs and how I tape the car up to minimize cleanup.
Most of the time this careful prep negates the need for any washing; we often wipe down any residue with a water-damp micro fiber.
However, sometimes a buff job gets more involved and messy and I need to wash the car. It just produces a better result for me personally.