They are hostile to outsiders because they have no immunity to modern diseases and in the past, each time someone tried to contact them a lot of them died.
This probably plays into their desire to remain isolated. If every time some wanderer landed on their island a lot of their people died then it makes sense that they would not welcome anyone from outside.