Skip to content

Collect companies from public listings

Where usable company data sits in the open, and how to get it into a database without a mess.

Guide · 8 min read · Updated 30 September 2026

Contacts list in Riftjaw with company, phone, email, segment, campaigns and tags
Riftjaw contacts on a phone

Why start from public listings

Most companies want to be found. They list themselves in directories, join associations, exhibit at trade fairs and publish their details on their own website. That makes public listings the most honest starting point for a B2B list: the company chose to be there, and you can always show where you found it.

A list you collect yourself is also more relevant than one you rent. You pick the niche and the region, and you know what every row means. The trade-off is effort. This guide keeps that effort small and the result clean.

Where company data sits in the open

Good sources share three traits: the companies are grouped by something you care about, each entry has a website or contact detail, and the list is maintained.

  • Trade associations and member lists. Often grouped by sector and region, and members are real, active businesses.
  • Trade fair exhibitor lists. Companies that pay to exhibit are actively looking for customers. Lists usually include a website and a short description.
  • Industry directories. Sector portals, supplier finders and marketplace listings, often with category filters.
  • Certification and quality registers. Lists of certified electricians, accredited labs or approved suppliers. Useful when certification matters to your offer.
  • Local business pages. Municipal or regional business directories and business park websites, handy for service businesses working one area.
  • Company websites. The "about" and "contact" pages give you the details the company itself wants you to use.

Official business registers are useful to check a company exists and what it does. Many of them have their own terms for reuse, so read those before you copy anything in bulk.

Respect the terms and robots.txt

Public does not mean free for any use. Before you collect from a site, check two things.

  • The terms of use. Many directories forbid automated collection or reuse of their listings. If they do, do not scrape them. Use the listing to find companies and visit their own sites instead.
  • robots.txt. Open example.com/robots.txt. It tells automated tools which paths the owner does not want visited. It is not a law, but ignoring it is a clear signal you are not welcome.

Collect at a human pace. Opening one page, saving its list and moving to the next is very different from firing thousands of requests at a server. Keep only what you need for business contact: company name, website, city, phone, a generic email. Skip private details. The GDPR guide explains why the source and date of every record matter.

Contact panel in Riftjaw with pipeline status, tags, details and campaign history
Every record in Riftjaw keeps its lead file and the date it was added, so you can always show where a company came from.

Collect with a browser extension

Browser extensions such as Instant Data Scraper read the page you have open, detect a repeating list or table and turn it into rows you can save as CSV or Excel. They work on the page in your own browser, so you see exactly what you collect.

A typical session looks like this:

  • Add the extension to your browser from its official store page.
  • Open the listing page, for example an exhibitor list filtered on your sector.
  • Start the extension. It highlights the table it thinks you want. If it picked the wrong block, try the next suggestion.
  • If the list spans several pages, point it at the "next" button and let it walk through them at a gentle pace.
  • Export to CSV or Excel and name the file after the source, like exhibitors-tradefair-2026.csv.

Or paste the page into Riftjaw

No extension, or a page the extension does not read well? Use paste and collect. Copy the HTML of the page you have open, paste it into the dashboard, pick the repeating blocks you need and turn them into rows. Those rows go straight to the import screen.

Riftjaw does not crawl the web itself. You supply the page, which keeps you in control of what you collect and where it came from.

Paste and collect in Riftjaw: a pasted web page turned into a table of companies
Paste and collect in Riftjaw. Only what you paste is read, the repeating blocks are found, and you switch on the columns you need.

Clean before you import

Five minutes of cleaning saves an hour of fixing records later. Open the file and check:

  • Columns. Delete columns that are only layout, like image links or "view profile" buttons.
  • Websites. Make sure the website column holds the company's own site, not a link back to the directory profile.
  • Empty rows. Remove rows without a company name. Scrapers often pick up headers and ads.
  • Mixed fields. A column like "Springfield, +44 20 7946 0142" is two fields. Split it now or map it to a note.
  • Source. Add a column with the source and the date you collected it, if the file does not say so already.

Import into your database

In the dashboard, open Import / Scrape and start a new import. Pick the segment the companies go into, or create one on the spot, such as "Plumbers North". Three steps follow: match the columns, check the import and publish the records.

No email column? Tick a few prefixes and derive addresses from the domain while importing. Then read the database guide to keep the list useful after week one.

From file to records in Riftjaw

Every column gets a field

Each column shows a few of its values and how many rows are filled, like 14 of 14. One column here still needs a choice, so nothing is imported yet. When there are several URL columns, you pick the real website, and an unknown column can become a new field.

How import works
Import in Riftjaw: every column matched to a profile field, with all rows previewed
An import with each column of the file matched to a profile field, going into the segment Roofers and builders, North.

Every import in one list

Each import and scrape shows its lead file, date, number of rows and status, such as Needs columns or Completed. Duplicates inside the file and against your database are flagged before anything is saved, and the original file stays attached.

List of imports and scrapes in Riftjaw
Imports and scrapes with their lead file, date, results and status.

Review, then publish

Records arrive as concepts. Look them over in the database and publish the good ones. If the whole import was a mistake, delete it in one go.

How records work
Database in Riftjaw with active contacts, segment, lead file and source
The database with concept, active and archived contacts, each with its lead file and source.

Questions people ask

It depends on the site's terms, on robots.txt and on the data. Business contact details a company published itself are the safest. If a directory's terms forbid automated collection, do not scrape it. This is not legal advice.

No. Riftjaw does not crawl the web. You open the page yourself and either use a browser extension or paste the HTML into paste and collect.

CSV with commas or semicolons, and Excel .xlsx. Most browser extensions export one of these.

Duplicates are flagged against the key field you choose, such as website, before anything is saved. You decide to skip or keep them.

Start with one focused source, such as one trade fair or one association in one region. A few hundred relevant companies are worth more than ten thousand random ones.

Turn your first listing into records

Start free, import the file you collected today and see every company as a record with its source and date.

No credit card · cancel any time · your data stays yours