That would be Akainu. During their attempts to escape, after Luffy had fallen unconscious following Ace's death, Jimbei was doing his damnedest to evade the Marine Admiral. A savage punch, penetrating Jimbei's body and ultimately hitting Luffy in the chest, was the cause of the scar.