Visitor chair with integrated armrests