The multiplication or reproduction of hemocytes, resulting in the expansion of the cell population. Hemocytes are blood cells associated with a hemocoel (the cavity containing most of the major organs of the arthropod body) which are involved in defense and clotting of hemolymph, but not involved in transport of oxygen.