Henry James' early environment was, as his older brother William James very justly said, the James family. It was an isolated culture of chosen intellectuals, of whom two younger brothers were of an extrovertish quality and his sister a nervous invalid of great intellectual force.
Source: wiktionary