Can you check on the lizards to see how they look like and their level of tameness? Then you will have some actual supportive evidence of your worries.
What is your brother's say on this? If your Mom is making decision; let her worry about your brother caring for his.