Unfortunately, no. Firstly, these items are being removed to be studied and taken care of. Secondly, even if Shinji managed to tuck a battle axe or massive stop sign (jeez, man, what did the stop sign do to you?) in his pocket/coat/something something sneaky theivery-- the items are way too fragile to be used as actual weapons. He might have better luck finding a PC good at weapon smithing or black market info to help arm himself!