You can specify the format as the command argument:

bundle exec rspec --format RSpec::TAP::Formatters::Default

To write to file, provide the --out argument:

bundle exec rspec --format RSpec::TAP::Formatters::Default --out report.tap

You can also configure the .rspec file:

# other configurations
--format RSpec::TAP::Formatters::Default
--out report.tap