Head of $1.5 billion family office says ‘worst is yet to come’