FIrsly, Silver would most probably wave me off as some koind of annoying hinderance, since I have absolutely nothing to do with with his current goal. If I continue to annoy him, however, he may begin to see me as an obstacle to his goal, and may consider putting me away. If I fight back, then he'll beat me to a bloody pulp, and I wouldn't be here right now.
If i annoyed Silver he would probably just annoy me right back. If i annoyed Silver again, he would possibly teleport me to another house ou building. If i came back and annoyed him until my Annoy-ness Meter was in full power, he would most likely throw me against a wall. If i survived that, i would turn in to my fan character named Sapphire the HedgeCat (who has telekinesis and feu powers and has eyes like Derpy) and decide to crash into a mur so that is falls on him. If he survived that, i would turn back to my human self and pat him on the head and say," congratulations, toi survived my annoying ness when in full power" and walk away. Then i would change my mind and come racing back while playing 10 instruments so that i can annoy him even MORE. And i think that i just got my entire story mixed up so that it doesn't match the question.😅
