As a kid we would swat them out of the air with something an if they had a white/off yellow colored spot on their forehead then it was safe to pick up with your hand in put in a jar or some kind of container....But without the spotted forehead we left them alone for our safety. ............................................... drill sgt.

A badminton racket works great on them. You can make a simple trap with a piece of 4x4 and a jar.

Carpenter bees prefer unpainted would and like many others have said bore zig zag tunnels around 9 to 12 inches in length. The real damage comes when wood peckers find the bees. Based on how zealously they hammer out these tunnels, I am guessing carpenter bees are the rib-eye of bugs for a wood pecker.

Great Stuff foam in a can.

As stated before, wait until evening, stick wand deep in hole, spray.
The next day, scrape a little foam out, and caulk, paint, done.

I do this a few times a year, at least. They are relentless here.

Little bastards are always attacking my house. If they are low level I swat them with a badminton racket. If I'm trying to take care of their holes I pump some diatomaceous earth into the hole and then pound a 1/2 inch cork covered in wood glue in the opening and saw it off flush then paint. The diatomaceous earth supposedly cuts their abdomens and they dry out and die.