Lien "caché" derrière un data-attribute

[Paladin]

Bonjour,

Je cherche à scraper les résultats d’un site internet, avec Webscraper.
Il y a 25 résultats par page, dans un tableau (voir ci-dessous)

Chaque ligne (tr) de ce tableau constitue l’une des lignes de mon fichier final (1 ligne = 1 entreprise)

La pagination semble fonctionner, j’ai un soucis sur la définition de mon sélecteur « page-link », qui me permettrait d’entrer sur la fiche de mon entreprise.

Je me suis aperçu que toute ma ligne (tr) est un lien qui envoie vers la page de l’entreprise.
Néanmoins, il n’y a pas de lien visible dans le code html (voir ci-dessous).

En creusant, j’ai découvert l’attribut « data-attribute », qui permet visiblement de stocker des données en dehors de la page html.

J’ai découvert dans l’outil network, que je retrouvais le lien de chaque ligne (entreprise) dans un fichier admin-ajax.php (voir image dessous).

Mes questions sont donc les suivantes :

• Est-il possible d’utiliser Web scraper pour aller chercher les liens dans le fichier « admin-ajax.php » afin de les renseigner comme « sélecteur » pour scraper toutes les pages ?
  Après de nombreuses recherches, il ne me semble pas …

• Si non, quel outils pourrais-je utiliser pour réaliser ce scraping ?

Je vous remercie de vos retours et éclairages, et reste à votre dispo si vous avez besoin d’infos supplémentaires !

[NicolasF]

Bonjour @Paladin,

J’utilise pas webscapper.
En Javascript cela est faisable.
Si tu codes pas, tu peux tenter (en supposant que tu veilles les membres.)
inurl:https://www.gicat.com/membre

C’est, à première vu ce que j’essaierai.

[ScrapingExpert]

Paladin… Pierre ???

Si tu es bien un de mes étudiants, je te dirais, essayes de revoir le cours qu’on a fait le dernier jour de la S1, et tu auras ta solution

Astuce: clic droit sur ta requête AJAX, « Copy response », et tu converti en JSON via le tool qu’on a vu ensemble chez Humind…

[Paladin]

Hello,

Merci pour vos réponses respectives !

@NicolasF , super piste. Ça me permet de scraper pas mal de data.
Néanmoins, je ne trouve que 99 entreprises via cette url, alors que sur ma page recherche j’ai 265 résultats… Il m’en manque donc la moitié.

@ScrapingExpert Merci de ton retour ! En effet, l’outil que tu me recommandes fonctionne bien, et je l’avais bien en tête
Néanmoins, je cherche à aller scraper les données qui sont présentes sur les pages des entreprises … (nom, adresses, site web, etc.)

Pour automatiser la démarche, il me faudrait reprendre et utiliser les url que j’ai récupéré à partir du json, puis aller chercher les infos sur chacune des pages …
Je n’ai pas trouvé la possibilité de la faire avec Webscraper ou Data miner.
Existe-t’il d’autres outils pour faire cela ?

Merci !

[ScrapingExpert]

Tu peux gérer ça avec WebScraper.

1. A partir de la colonne « link » que tu récupère dans le fichier Excel/CSV généré après conversion du JSON:

link
https://www.gicat.com/membre/4d-virtualiz/
https://www.gicat.com/membre/trescal-2/
https://www.gicat.com/membre/accenture/
https://www.gicat.com/membre/acierplus/
https://www.gicat.com/membre/acmh/
https://www.gicat.com/membre/actia-telecom/
https://www.gicat.com/membre/aeraccess/
https://www.gicat.com/membre/aeronet/
https://www.gicat.com/membre/agueris/
https://www.gicat.com/membre/air-lynx/
https://www.gicat.com/membre/airbus-defence-space-2/
https://www.gicat.com/membre/airbus-group/
https://www.gicat.com/membre/airbus-helicopters/
https://www.gicat.com/membre/akka/
https://www.gicat.com/membre/altran/
https://www.gicat.com/membre/amco-les-escamotables/
https://www.gicat.com/membre/amefo/
https://www.gicat.com/membre/amphenol-socapex-fr/
https://www.gicat.com/membre/anjou-electronique/
https://www.gicat.com/membre/apilog-automation/
https://www.gicat.com/membre/aprres-industries/
https://www.gicat.com/membre/ardanti-defense/
https://www.gicat.com/membre/1299/
https://www.gicat.com/membre/intermas/
https://www.gicat.com/membre/arinc-sa/
https://www.gicat.com/membre/armtek/
https://www.gicat.com/membre/artefact/
https://www.gicat.com/membre/artem-defense/
https://www.gicat.com/membre/asb-batteries-aerospatiales/
https://www.gicat.com/membre/assistance-aeronautique-aerospatiale/
https://www.gicat.com/membre/atermes-2/
https://www.gicat.com/membre/atos/
https://www.gicat.com/membre/banc-national-depreuve/
https://www.gicat.com/membre/banc-officiel-depreuve/
https://www.gicat.com/membre/bbe-developpement/
https://www.gicat.com/membre/bbe-developpment/
https://www.gicat.com/membre/bearingpoint/
https://www.gicat.com/membre/bernier-2/
https://www.gicat.com/membre/bernier/
https://www.gicat.com/membre/bertin-technologies/
https://www.gicat.com/membre/besse-conseil-en-assurances/
https://www.gicat.com/membre/body-armor-recycler/
https://www.gicat.com/membre/bollore-logistics/
https://www.gicat.com/membre/bren-tronics-international-solutions/
https://www.gicat.com/membre/brm-industrie/
https://www.gicat.com/membre/came-urbaco-solutions-de-controle-dacces-et-de-securite-des-zones-urbaines-par-bornes-escamotables/
https://www.gicat.com/membre/carrosserie-behm/
https://www.gicat.com/membre/cefa/
https://www.gicat.com/membre/cegelec-defense-2/
https://www.gicat.com/membre/cegelec-defense/
https://www.gicat.com/membre/centigon/
https://www.gicat.com/membre/cepa/
https://www.gicat.com/membre/cesta/
https://www.gicat.com/membre/cilas-2/
https://www.gicat.com/membre/cilas/
https://www.gicat.com/membre/civi-pol-conseil/
https://www.gicat.com/membre/ckp-lart-de-penser-autrement/
https://www.gicat.com/membre/cmi-defence/
https://www.gicat.com/membre/cmi-defence-2/
https://www.gicat.com/membre/cnim/
https://www.gicat.com/membre/cobham/
https://www.gicat.com/membre/comrod/
https://www.gicat.com/membre/cordon-ds2i-2/
https://www.gicat.com/membre/__trashed-8/
https://www.gicat.com/membre/critical-building/
https://www.gicat.com/membre/crystal-system-consulting/
https://www.gicat.com/membre/cs-communications/
https://www.gicat.com/membre/daher/
https://www.gicat.com/membre/datahertz/
https://www.gicat.com/membre/davey-bickford/
https://www.gicat.com/membre/dci/
https://www.gicat.com/membre/deschamps/
https://www.gicat.com/membre/deveryware/
https://www.gicat.com/membre/dixi-microtechniques/
https://www.gicat.com/membre/docaret/
https://www.gicat.com/membre/drone-volt/
https://www.gicat.com/membre/eads-gdi-simulation/
https://www.gicat.com/membre/eca-group-2/
https://www.gicat.com/membre/eca-group/
https://www.gicat.com/membre/ecrin-systems/
https://www.gicat.com/membre/eden/
https://www.gicat.com/membre/edicia-sas/
https://www.gicat.com/membre/egidium-technologies-2/
https://www.gicat.com/membre/egidium-technologies/
https://www.gicat.com/membre/elno/
https://www.gicat.com/membre/em2-industries/
https://www.gicat.com/membre/enag/
https://www.gicat.com/membre/cofely-ineo/
https://www.gicat.com/membre/eolane/
https://www.gicat.com/membre/epci/
https://www.gicat.com/membre/serpe-protection-des-sites-sensibles/
https://www.gicat.com/membre/erys-group-2/
https://www.gicat.com/membre/esdt/
https://www.gicat.com/membre/essonne-securite/
https://www.gicat.com/membre/eurenco/
https://www.gicat.com/membre/evitech/
https://www.gicat.com/membre/exavision/
https://www.gicat.com/membre/exemple/
https://www.gicat.com/membre/factem-2/
https://www.gicat.com/membre/force-reseau/
https://www.gicat.com/membre/france-maccaferri/
https://www.gicat.com/membre/frenchshield-la-surete-360/
https://www.gicat.com/membre/frz-consulting/
https://www.gicat.com/membre/gabriel-2/
https://www.gicat.com/membre/gaches-chimie/
https://www.gicat.com/membre/__trashed-5/
https://www.gicat.com/membre/geo4i/
https://www.gicat.com/membre/geodis/
https://www.gicat.com/membre/geomatys-geodata-intelligence-leads-your-decisions/
https://www.gicat.com/membre/geos/
https://www.gicat.com/membre/gicat-groupement/
https://www.gicat.com/membre/gie-defense-nbc/
...etc

2. Tu créé un tableau JSON à partir de cette liste d’URLs, tel que:

["https://www.gicat.com/membre/4d-virtualiz/", "https://www.gicat.com/membre/trescal-2/", "https://www.gicat.com/membre/accenture/", "https://www.gicat.com/membre/acierplus/", "https://www.gicat.com/membre/acmh/", "https://www.gicat.com/membre/actia-telecom/", "https://www.gicat.com/membre/aeraccess/", "https://www.gicat.com/membre/aeronet/", "https://www.gicat.com/membre/agueris/", "https://www.gicat.com/membre/air-lynx/", "https://www.gicat.com/membre/airbus-defence-space-2/", "https://www.gicat.com/membre/airbus-group/", "https://www.gicat.com/membre/airbus-helicopters/", "https://www.gicat.com/membre/akka/", "https://www.gicat.com/membre/altran/", "https://www.gicat.com/membre/amco-les-escamotables/", "https://www.gicat.com/membre/amefo/", "https://www.gicat.com/membre/amphenol-socapex-fr/", "https://www.gicat.com/membre/anjou-electronique/", "https://www.gicat.com/membre/apilog-automation/", "https://www.gicat.com/membre/aprres-industries/", "https://www.gicat.com/membre/ardanti-defense/", "https://www.gicat.com/membre/1299/", "https://www.gicat.com/membre/intermas/", "https://www.gicat.com/membre/arinc-sa/", "https://www.gicat.com/membre/armtek/", "https://www.gicat.com/membre/artefact/", "https://www.gicat.com/membre/artem-defense/", "https://www.gicat.com/membre/asb-batteries-aerospatiales/", "https://www.gicat.com/membre/assistance-aeronautique-aerospatiale/", "https://www.gicat.com/membre/atermes-2/", "https://www.gicat.com/membre/atos/", "https://www.gicat.com/membre/banc-national-depreuve/", "https://www.gicat.com/membre/banc-officiel-depreuve/", "https://www.gicat.com/membre/bbe-developpement/", "https://www.gicat.com/membre/bbe-developpment/", "https://www.gicat.com/membre/bearingpoint/", "https://www.gicat.com/membre/bernier-2/", "https://www.gicat.com/membre/bernier/", "https://www.gicat.com/membre/bertin-technologies/", "https://www.gicat.com/membre/besse-conseil-en-assurances/", "https://www.gicat.com/membre/body-armor-recycler/", "https://www.gicat.com/membre/bollore-logistics/", "https://www.gicat.com/membre/bren-tronics-international-solutions/", "https://www.gicat.com/membre/brm-industrie/", "https://www.gicat.com/membre/came-urbaco-solutions-de-controle-dacces-et-de-securite-des-zones-urbaines-par-bornes-escamotables/", "https://www.gicat.com/membre/carrosserie-behm/", "https://www.gicat.com/membre/cefa/", "https://www.gicat.com/membre/cegelec-defense-2/", "https://www.gicat.com/membre/cegelec-defense/", "https://www.gicat.com/membre/centigon/", "https://www.gicat.com/membre/cepa/", "https://www.gicat.com/membre/cesta/", "https://www.gicat.com/membre/cilas-2/", "https://www.gicat.com/membre/cilas/", "https://www.gicat.com/membre/civi-pol-conseil/", "https://www.gicat.com/membre/ckp-lart-de-penser-autrement/", "https://www.gicat.com/membre/cmi-defence/", "https://www.gicat.com/membre/cmi-defence-2/", "https://www.gicat.com/membre/cnim/", "https://www.gicat.com/membre/cobham/", "https://www.gicat.com/membre/comrod/", "https://www.gicat.com/membre/cordon-ds2i-2/", "https://www.gicat.com/membre/__trashed-8/", "https://www.gicat.com/membre/critical-building/", "https://www.gicat.com/membre/crystal-system-consulting/", "https://www.gicat.com/membre/cs-communications/", "https://www.gicat.com/membre/daher/", "https://www.gicat.com/membre/datahertz/", "https://www.gicat.com/membre/davey-bickford/", "https://www.gicat.com/membre/dci/", "https://www.gicat.com/membre/deschamps/", "https://www.gicat.com/membre/deveryware/", "https://www.gicat.com/membre/dixi-microtechniques/", "https://www.gicat.com/membre/docaret/", "https://www.gicat.com/membre/drone-volt/", "https://www.gicat.com/membre/eads-gdi-simulation/", "https://www.gicat.com/membre/eca-group-2/", "https://www.gicat.com/membre/eca-group/", "https://www.gicat.com/membre/ecrin-systems/", "https://www.gicat.com/membre/eden/", "https://www.gicat.com/membre/edicia-sas/", "https://www.gicat.com/membre/egidium-technologies-2/", "https://www.gicat.com/membre/egidium-technologies/", "https://www.gicat.com/membre/elno/", "https://www.gicat.com/membre/em2-industries/", "https://www.gicat.com/membre/enag/", "https://www.gicat.com/membre/cofely-ineo/", "https://www.gicat.com/membre/eolane/", "https://www.gicat.com/membre/epci/", "https://www.gicat.com/membre/serpe-protection-des-sites-sensibles/", "https://www.gicat.com/membre/erys-group-2/", "https://www.gicat.com/membre/esdt/", "https://www.gicat.com/membre/essonne-securite/", "https://www.gicat.com/membre/eurenco/", "https://www.gicat.com/membre/evitech/", "https://www.gicat.com/membre/exavision/", "https://www.gicat.com/membre/exemple/", "https://www.gicat.com/membre/factem-2/", "https://www.gicat.com/membre/force-reseau/", "https://www.gicat.com/membre/france-maccaferri/", "https://www.gicat.com/membre/frenchshield-la-surete-360/", "https://www.gicat.com/membre/frz-consulting/", "https://www.gicat.com/membre/gabriel-2/", "https://www.gicat.com/membre/gaches-chimie/", "https://www.gicat.com/membre/__trashed-5/", "https://www.gicat.com/membre/geo4i/", "https://www.gicat.com/membre/geodis/", "https://www.gicat.com/membre/geomatys-geodata-intelligence-leads-your-decisions/", "https://www.gicat.com/membre/geos/", "https://www.gicat.com/membre/gicat-groupement/", "https://www.gicat.com/membre/gie-defense-nbc/", "https://www.gicat.com/membre/gilep/", "https://www.gicat.com/membre/gk-professionnal/", "https://www.gicat.com/membre/groupe-legendre/", "https://www.gicat.com/membre/groupe-marck/", "https://www.gicat.com/membre/gudel-sumer/", "https://www.gicat.com/membre/hebco-industrie/", "https://www.gicat.com/membre/helidax/", "https://www.gicat.com/membre/henri-blanc-sa/", "https://www.gicat.com/membre/hgh-2/", "https://www.gicat.com/membre/hutchinson-snc-2/", "https://www.gicat.com/membre/hutchinson-snc/", "https://www.gicat.com/membre/ihs-global-sas/", "https://www.gicat.com/membre/impact/", "https://www.gicat.com/membre/impact-sas/", "https://www.gicat.com/membre/ims-innovation-and-measurement-systems/", "https://www.gicat.com/membre/industeel-arcelor-mittal/", "https://www.gicat.com/membre/inpixal/", "https://www.gicat.com/membre/institut-vedecom/", "https://www.gicat.com/membre/isd/", "https://www.gicat.com/membre/isl/", "https://www.gicat.com/membre/ixblue/", "https://www.gicat.com/membre/jalgos/", "https://www.gicat.com/membre/jalgos-2/", "https://www.gicat.com/membre/junghans-t2m/", "https://www.gicat.com/membre/kopp/", "https://www.gicat.com/membre/lacroix-2/", "https://www.gicat.com/membre/lamberet-sas/", "https://www.gicat.com/membre/lgm/", "https://www.gicat.com/membre/lh-aviation/", "https://www.gicat.com/membre/lheritier/", "https://www.gicat.com/membre/lockself-2/", "https://www.gicat.com/membre/lockself/", "https://www.gicat.com/membre/losberger-rds/", "https://www.gicat.com/membre/luceor-2/", "https://www.gicat.com/membre/luceor/", "https://www.gicat.com/membre/mader-group/", "https://www.gicat.com/membre/manitou/", "https://www.gicat.com/membre/masa/", "https://www.gicat.com/membre/mbda/", "https://www.gicat.com/membre/mc2-technologies/", "https://www.gicat.com/membre/mecapole-de-la-forge-au-traitement-de-surface-en-passant-par-lusinage-la-tolerie-chaudronnerie-les-elastomeres/", "https://www.gicat.com/membre/metravib/", "https://www.gicat.com/membre/michelin/", "https://www.gicat.com/membre/michelin/", "https://www.gicat.com/membre/moog-2/", "https://www.gicat.com/membre/moog/", "https://www.gicat.com/membre/defense-equipement-conseil/", "https://www.gicat.com/membre/musthane-2/", "https://www.gicat.com/membre/musthane/", "https://www.gicat.com/membre/nae-normandie-aeroespace/", "https://www.gicat.com/membre/nexeya/", "https://www.gicat.com/membre/nexter/", "https://www.gicat.com/membre/nexter-robotics/", "https://www.gicat.com/membre/nicolas-industrie-sas/", "https://www.gicat.com/membre/nobel-sport/", "https://www.gicat.com/membre/nse/", "https://www.gicat.com/membre/navi-trade-forwarders/", "https://www.gicat.com/membre/nuances-technologies/", "https://www.gicat.com/membre/nyco/", "https://www.gicat.com/membre/odas/", "https://www.gicat.com/membre/olea-innovation-a-la-pointe-de-la-technologie-et-de-la-chimie/", "https://www.gicat.com/membre/omat-2/", "https://www.gicat.com/membre/omat/", "https://www.gicat.com/membre/onera/", "https://www.gicat.com/membre/orolia/", "https://www.gicat.com/membre/ouvry/", "https://www.gicat.com/membre/pewag/", "https://www.gicat.com/membre/photonis/", "https://www.gicat.com/membre/proengin/", "https://www.gicat.com/membre/pronergy/", "https://www.gicat.com/membre/protecop/", "https://www.gicat.com/membre/prove-run/", "https://www.gicat.com/membre/quiri/", "https://www.gicat.com/membre/racine-group/", "https://www.gicat.com/membre/rcy-reynaud-cauvin-yvose-2/", "https://www.gicat.com/membre/rcy-reynaud-cauvin-yvose/", "https://www.gicat.com/membre/redcore-sas/", "https://www.gicat.com/membre/reflex-ces/", "https://www.gicat.com/membre/renault-trucks-defense/", "https://www.gicat.com/membre/renk-france/", "https://www.gicat.com/membre/1657/", "https://www.gicat.com/membre/riskco/", "https://www.gicat.com/membre/rockwell-collins-france/", "https://www.gicat.com/membre/roxel-2/", "https://www.gicat.com/membre/roxel/", "https://www.gicat.com/membre/ruagfrance/", "https://www.gicat.com/membre/sapl/", "https://www.gicat.com/membre/s2e-consulting/", "https://www.gicat.com/membre/saagie/", "https://www.gicat.com/membre/sagem/", "https://www.gicat.com/membre/saint-gobain-armor/", "https://www.gicat.com/membre/saphymo/", "https://www.gicat.com/membre/saphymo/", "https://www.gicat.com/membre/sapl-2/", "https://www.gicat.com/membre/satelit-odysur/", "https://www.gicat.com/membre/schneider-electric/", "https://www.gicat.com/membre/scioteq/", "https://www.gicat.com/membre/scrome/", "https://www.gicat.com/membre/secapem/", "https://www.gicat.com/membre/segula-technologies/", "https://www.gicat.com/membre/sema-world/", "https://www.gicat.com/membre/semia/", "https://www.gicat.com/membre/sera-ingenierie/", "https://www.gicat.com/membre/sert/", "https://www.gicat.com/membre/sert-2/", "https://www.gicat.com/membre/sides/", "https://www.gicat.com/membre/silkan/", "https://www.gicat.com/membre/silmach/", "https://www.gicat.com/membre/silmach/", "https://www.gicat.com/membre/sinequa-l-become-information-driven/", "https://www.gicat.com/membre/sofema/", "https://www.gicat.com/membre/soflog-telis/", "https://www.gicat.com/membre/soframe/", "https://www.gicat.com/membre/solarmtex/", "https://www.gicat.com/membre/sophia-conseil/", "https://www.gicat.com/membre/sopra-steria/", "https://www.gicat.com/membre/spartan-military-law-enforcement/", "https://www.gicat.com/membre/spherea/", "https://www.gicat.com/membre/starter-groupe-dld/", "https://www.gicat.com/membre/starter-groupe-dld/", "https://www.gicat.com/membre/sterela/", "https://www.gicat.com/membre/studec/", "https://www.gicat.com/membre/studec/", "https://www.gicat.com/membre/sunrock/", "https://www.gicat.com/membre/sunrock/", "https://www.gicat.com/membre/survey-copter/", "https://www.gicat.com/membre/surys/", "https://www.gicat.com/membre/surys/", "https://www.gicat.com/membre/sysnav/", "https://www.gicat.com/membre/systran/", "https://www.gicat.com/membre/taprackbang-trb-holsters/", "https://www.gicat.com/membre/teb/", "https://www.gicat.com/membre/teb/", "https://www.gicat.com/membre/technic-export/", "https://www.gicat.com/membre/technic-export-2/", "https://www.gicat.com/membre/1746/", "https://www.gicat.com/membre/teleflow/", "https://www.gicat.com/membre/texelis/", "https://www.gicat.com/membre/thales-group/", "https://www.gicat.com/membre/thales-group-2/", "https://www.gicat.com/membre/titan-aviation/", "https://www.gicat.com/membre/tracip/", "https://www.gicat.com/membre/tracip/", "https://www.gicat.com/membre/trescal/", "https://www.gicat.com/membre/unac-hydrostatic-vehicle-creator/", "https://www.gicat.com/membre/unac/", "https://www.gicat.com/membre/utilis-sas-2/", "https://www.gicat.com/membre/verney-carron/", "https://www.gicat.com/membre/verney-carron/", "https://www.gicat.com/membre/vocapia-research/", "https://www.gicat.com/membre/vocapia-research/", "https://www.gicat.com/membre/zhendre/", "https://www.gicat.com/membre/zodiac-aerosafety-systems/"]

3. Tu export ton sitemap JSON, tu l’édites et tu remplaces le tableau associé à la clé startURL:

{"_id":"gigacat-members","startUrl":["https://www.gicat.com/membre/4d-virtualiz/", "https://www.gicat.com/membre/trescal-2/", "https://www.gicat.com/membre/accenture/", "https://www.gicat.com/membre/acierplus/", "https://www.gicat.com/membre/acmh/", "https://www.gicat.com/membre/actia-telecom/", "https://www.gicat.com/membre/aeraccess/", "https://www.gicat.com/membre/aeronet/", "https://www.gicat.com/membre/agueris/", "https://www.gicat.com/membre/air-lynx/", "https://www.gicat.com/membre/airbus-defence-space-2/", "https://www.gicat.com/membre/airbus-group/", "https://www.gicat.com/membre/airbus-helicopters/", "https://www.gicat.com/membre/akka/", "https://www.gicat.com/membre/altran/", "https://www.gicat.com/membre/amco-les-escamotables/", "https://www.gicat.com/membre/amefo/", "https://www.gicat.com/membre/amphenol-socapex-fr/", "https://www.gicat.com/membre/anjou-electronique/", "https://www.gicat.com/membre/apilog-automation/", "https://www.gicat.com/membre/aprres-industries/", "https://www.gicat.com/membre/ardanti-defense/", "https://www.gicat.com/membre/1299/", "https://www.gicat.com/membre/intermas/", "https://www.gicat.com/membre/arinc-sa/", "https://www.gicat.com/membre/armtek/", "https://www.gicat.com/membre/artefact/", "https://www.gicat.com/membre/artem-defense/", "https://www.gicat.com/membre/asb-batteries-aerospatiales/", "https://www.gicat.com/membre/assistance-aeronautique-aerospatiale/", "https://www.gicat.com/membre/atermes-2/", "https://www.gicat.com/membre/atos/", "https://www.gicat.com/membre/banc-national-depreuve/", "https://www.gicat.com/membre/banc-officiel-depreuve/", "https://www.gicat.com/membre/bbe-developpement/", "https://www.gicat.com/membre/bbe-developpment/", "https://www.gicat.com/membre/bearingpoint/", "https://www.gicat.com/membre/bernier-2/", "https://www.gicat.com/membre/bernier/", "https://www.gicat.com/membre/bertin-technologies/", "https://www.gicat.com/membre/besse-conseil-en-assurances/", "https://www.gicat.com/membre/body-armor-recycler/", "https://www.gicat.com/membre/bollore-logistics/", "https://www.gicat.com/membre/bren-tronics-international-solutions/", "https://www.gicat.com/membre/brm-industrie/", "https://www.gicat.com/membre/came-urbaco-solutions-de-controle-dacces-et-de-securite-des-zones-urbaines-par-bornes-escamotables/", "https://www.gicat.com/membre/carrosserie-behm/", "https://www.gicat.com/membre/cefa/", "https://www.gicat.com/membre/cegelec-defense-2/", "https://www.gicat.com/membre/cegelec-defense/", "https://www.gicat.com/membre/centigon/", "https://www.gicat.com/membre/cepa/", "https://www.gicat.com/membre/cesta/", "https://www.gicat.com/membre/cilas-2/", "https://www.gicat.com/membre/cilas/", "https://www.gicat.com/membre/civi-pol-conseil/", "https://www.gicat.com/membre/ckp-lart-de-penser-autrement/", "https://www.gicat.com/membre/cmi-defence/", "https://www.gicat.com/membre/cmi-defence-2/", "https://www.gicat.com/membre/cnim/", "https://www.gicat.com/membre/cobham/", "https://www.gicat.com/membre/comrod/", "https://www.gicat.com/membre/cordon-ds2i-2/", "https://www.gicat.com/membre/__trashed-8/", "https://www.gicat.com/membre/critical-building/", "https://www.gicat.com/membre/crystal-system-consulting/", "https://www.gicat.com/membre/cs-communications/", "https://www.gicat.com/membre/daher/", "https://www.gicat.com/membre/datahertz/", "https://www.gicat.com/membre/davey-bickford/", "https://www.gicat.com/membre/dci/", "https://www.gicat.com/membre/deschamps/", "https://www.gicat.com/membre/deveryware/", "https://www.gicat.com/membre/dixi-microtechniques/", "https://www.gicat.com/membre/docaret/", "https://www.gicat.com/membre/drone-volt/", "https://www.gicat.com/membre/eads-gdi-simulation/", "https://www.gicat.com/membre/eca-group-2/", "https://www.gicat.com/membre/eca-group/", "https://www.gicat.com/membre/ecrin-systems/", "https://www.gicat.com/membre/eden/", "https://www.gicat.com/membre/edicia-sas/", "https://www.gicat.com/membre/egidium-technologies-2/", "https://www.gicat.com/membre/egidium-technologies/", "https://www.gicat.com/membre/elno/", "https://www.gicat.com/membre/em2-industries/", "https://www.gicat.com/membre/enag/", "https://www.gicat.com/membre/cofely-ineo/", "https://www.gicat.com/membre/eolane/", "https://www.gicat.com/membre/epci/", "https://www.gicat.com/membre/serpe-protection-des-sites-sensibles/", "https://www.gicat.com/membre/erys-group-2/", "https://www.gicat.com/membre/esdt/", "https://www.gicat.com/membre/essonne-securite/", "https://www.gicat.com/membre/eurenco/", "https://www.gicat.com/membre/evitech/", "https://www.gicat.com/membre/exavision/", "https://www.gicat.com/membre/exemple/", "https://www.gicat.com/membre/factem-2/", "https://www.gicat.com/membre/force-reseau/", "https://www.gicat.com/membre/france-maccaferri/", "https://www.gicat.com/membre/frenchshield-la-surete-360/", "https://www.gicat.com/membre/frz-consulting/", "https://www.gicat.com/membre/gabriel-2/", "https://www.gicat.com/membre/gaches-chimie/", "https://www.gicat.com/membre/__trashed-5/", "https://www.gicat.com/membre/geo4i/", "https://www.gicat.com/membre/geodis/", "https://www.gicat.com/membre/geomatys-geodata-intelligence-leads-your-decisions/", "https://www.gicat.com/membre/geos/", "https://www.gicat.com/membre/gicat-groupement/", "https://www.gicat.com/membre/gie-defense-nbc/", "https://www.gicat.com/membre/gilep/", "https://www.gicat.com/membre/gk-professionnal/", "https://www.gicat.com/membre/groupe-legendre/", "https://www.gicat.com/membre/groupe-marck/", "https://www.gicat.com/membre/gudel-sumer/", "https://www.gicat.com/membre/hebco-industrie/", "https://www.gicat.com/membre/helidax/", "https://www.gicat.com/membre/henri-blanc-sa/", "https://www.gicat.com/membre/hgh-2/", "https://www.gicat.com/membre/hutchinson-snc-2/", "https://www.gicat.com/membre/hutchinson-snc/", "https://www.gicat.com/membre/ihs-global-sas/", "https://www.gicat.com/membre/impact/", "https://www.gicat.com/membre/impact-sas/", "https://www.gicat.com/membre/ims-innovation-and-measurement-systems/", "https://www.gicat.com/membre/industeel-arcelor-mittal/", "https://www.gicat.com/membre/inpixal/", "https://www.gicat.com/membre/institut-vedecom/", "https://www.gicat.com/membre/isd/", "https://www.gicat.com/membre/isl/", "https://www.gicat.com/membre/ixblue/", "https://www.gicat.com/membre/jalgos/", "https://www.gicat.com/membre/jalgos-2/", "https://www.gicat.com/membre/junghans-t2m/", "https://www.gicat.com/membre/kopp/", "https://www.gicat.com/membre/lacroix-2/", "https://www.gicat.com/membre/lamberet-sas/", "https://www.gicat.com/membre/lgm/", "https://www.gicat.com/membre/lh-aviation/", "https://www.gicat.com/membre/lheritier/", "https://www.gicat.com/membre/lockself-2/", "https://www.gicat.com/membre/lockself/", "https://www.gicat.com/membre/losberger-rds/", "https://www.gicat.com/membre/luceor-2/", "https://www.gicat.com/membre/luceor/", "https://www.gicat.com/membre/mader-group/", "https://www.gicat.com/membre/manitou/", "https://www.gicat.com/membre/masa/", "https://www.gicat.com/membre/mbda/", "https://www.gicat.com/membre/mc2-technologies/", "https://www.gicat.com/membre/mecapole-de-la-forge-au-traitement-de-surface-en-passant-par-lusinage-la-tolerie-chaudronnerie-les-elastomeres/", "https://www.gicat.com/membre/metravib/", "https://www.gicat.com/membre/michelin/", "https://www.gicat.com/membre/michelin/", "https://www.gicat.com/membre/moog-2/", "https://www.gicat.com/membre/moog/", "https://www.gicat.com/membre/defense-equipement-conseil/", "https://www.gicat.com/membre/musthane-2/", "https://www.gicat.com/membre/musthane/", "https://www.gicat.com/membre/nae-normandie-aeroespace/", "https://www.gicat.com/membre/nexeya/", "https://www.gicat.com/membre/nexter/", "https://www.gicat.com/membre/nexter-robotics/", "https://www.gicat.com/membre/nicolas-industrie-sas/", "https://www.gicat.com/membre/nobel-sport/", "https://www.gicat.com/membre/nse/", "https://www.gicat.com/membre/navi-trade-forwarders/", "https://www.gicat.com/membre/nuances-technologies/", "https://www.gicat.com/membre/nyco/", "https://www.gicat.com/membre/odas/", "https://www.gicat.com/membre/olea-innovation-a-la-pointe-de-la-technologie-et-de-la-chimie/", "https://www.gicat.com/membre/omat-2/", "https://www.gicat.com/membre/omat/", "https://www.gicat.com/membre/onera/", "https://www.gicat.com/membre/orolia/", "https://www.gicat.com/membre/ouvry/", "https://www.gicat.com/membre/pewag/", "https://www.gicat.com/membre/photonis/", "https://www.gicat.com/membre/proengin/", "https://www.gicat.com/membre/pronergy/", "https://www.gicat.com/membre/protecop/", "https://www.gicat.com/membre/prove-run/", "https://www.gicat.com/membre/quiri/", "https://www.gicat.com/membre/racine-group/", "https://www.gicat.com/membre/rcy-reynaud-cauvin-yvose-2/", "https://www.gicat.com/membre/rcy-reynaud-cauvin-yvose/", "https://www.gicat.com/membre/redcore-sas/", "https://www.gicat.com/membre/reflex-ces/", "https://www.gicat.com/membre/renault-trucks-defense/", "https://www.gicat.com/membre/renk-france/", "https://www.gicat.com/membre/1657/", "https://www.gicat.com/membre/riskco/", "https://www.gicat.com/membre/rockwell-collins-france/", "https://www.gicat.com/membre/roxel-2/", "https://www.gicat.com/membre/roxel/", "https://www.gicat.com/membre/ruagfrance/", "https://www.gicat.com/membre/sapl/", "https://www.gicat.com/membre/s2e-consulting/", "https://www.gicat.com/membre/saagie/", "https://www.gicat.com/membre/sagem/", "https://www.gicat.com/membre/saint-gobain-armor/", "https://www.gicat.com/membre/saphymo/", "https://www.gicat.com/membre/saphymo/", "https://www.gicat.com/membre/sapl-2/", "https://www.gicat.com/membre/satelit-odysur/", "https://www.gicat.com/membre/schneider-electric/", "https://www.gicat.com/membre/scioteq/", "https://www.gicat.com/membre/scrome/", "https://www.gicat.com/membre/secapem/", "https://www.gicat.com/membre/segula-technologies/", "https://www.gicat.com/membre/sema-world/", "https://www.gicat.com/membre/semia/", "https://www.gicat.com/membre/sera-ingenierie/", "https://www.gicat.com/membre/sert/", "https://www.gicat.com/membre/sert-2/", "https://www.gicat.com/membre/sides/", "https://www.gicat.com/membre/silkan/", "https://www.gicat.com/membre/silmach/", "https://www.gicat.com/membre/silmach/", "https://www.gicat.com/membre/sinequa-l-become-information-driven/", "https://www.gicat.com/membre/sofema/", "https://www.gicat.com/membre/soflog-telis/", "https://www.gicat.com/membre/soframe/", "https://www.gicat.com/membre/solarmtex/", "https://www.gicat.com/membre/sophia-conseil/", "https://www.gicat.com/membre/sopra-steria/", "https://www.gicat.com/membre/spartan-military-law-enforcement/", "https://www.gicat.com/membre/spherea/", "https://www.gicat.com/membre/starter-groupe-dld/", "https://www.gicat.com/membre/starter-groupe-dld/", "https://www.gicat.com/membre/sterela/", "https://www.gicat.com/membre/studec/", "https://www.gicat.com/membre/studec/", "https://www.gicat.com/membre/sunrock/", "https://www.gicat.com/membre/sunrock/", "https://www.gicat.com/membre/survey-copter/", "https://www.gicat.com/membre/surys/", "https://www.gicat.com/membre/surys/", "https://www.gicat.com/membre/sysnav/", "https://www.gicat.com/membre/systran/", "https://www.gicat.com/membre/taprackbang-trb-holsters/", "https://www.gicat.com/membre/teb/", "https://www.gicat.com/membre/teb/", "https://www.gicat.com/membre/technic-export/", "https://www.gicat.com/membre/technic-export-2/", "https://www.gicat.com/membre/1746/", "https://www.gicat.com/membre/teleflow/", "https://www.gicat.com/membre/texelis/", "https://www.gicat.com/membre/thales-group/", "https://www.gicat.com/membre/thales-group-2/", "https://www.gicat.com/membre/titan-aviation/", "https://www.gicat.com/membre/tracip/", "https://www.gicat.com/membre/tracip/", "https://www.gicat.com/membre/trescal/", "https://www.gicat.com/membre/unac-hydrostatic-vehicle-creator/", "https://www.gicat.com/membre/unac/", "https://www.gicat.com/membre/utilis-sas-2/", "https://www.gicat.com/membre/verney-carron/", "https://www.gicat.com/membre/verney-carron/", "https://www.gicat.com/membre/vocapia-research/", "https://www.gicat.com/membre/vocapia-research/", "https://www.gicat.com/membre/zhendre/", "https://www.gicat.com/membre/zodiac-aerosafety-systems/"],"selectors":[{"id":"company","type":"SelectorText","parentSelectors":["_root"],"selector":"span","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["_root"],"selector":"span","multiple":false,"regex":"","delay":0}]}

4. Puis tu refais une nouvelle config WebScraper en important ce nouveau sitemap édité

5. Enfin tu créé les sélecteurs textes de toutes les infos que tu souhaites extraire, directement à la racine de ta config.

En résumé, on a indiqué à WebScraper de prendre comme starting point toutes les URLS précédentes extraites.

[NicolasF]

A un moment, dans google il y a écrit un truc du genre « des résultats ont été omis ». Une fois que tu as cliqué dessus, il t’affiche tout. Mais la solution de @ScrapingExpert est mieux et plus fiable. Il faut que je check l’outil.

[Paladin]

@NicolasF & @ScrapingExpert
Merci de vos retours !

@Xavier, super, ça fonctionne très bien ! Merci beaucoup !