Johnny Scott, 26, drove his VW Polo into the south centre gate of the royal residence on March 9 last year, causing £24,493 in damage.
National Crime Agency officers detained the men at addresses in Leicester, Birmingham, Essex and south London.