{"id":2795,"date":"2023-05-08T20:26:15","date_gmt":"2023-05-08T20:26:15","guid":{"rendered":"http:\/\/clam.com.br\/?p=2795"},"modified":"2026-01-07T11:46:48","modified_gmt":"2026-01-07T14:46:48","slug":"web-scrapping","status":"publish","type":"post","link":"https:\/\/clam.com.br\/en\/web-scrapping\/","title":{"rendered":"WEB SCRAPPING"},"content":{"rendered":"<figure class=\"wp-block-image size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/clam.olyva.com.br\/wp-content\/uploads\/2023\/05\/web-scrapper-Title.png\" alt=\"\" class=\"wp-image-2796\" width=\"283\" height=\"47\"\/><\/figure>\n\n\n\n<div style=\"height:14px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image alignleft size-large is-resized\"><img fetchpriority=\"high\" decoding=\"async\" src=\"https:\/\/clam.olyva.com.br\/wp-content\/uploads\/2023\/05\/web-scrapper-1024x567.png\" alt=\"\" class=\"wp-image-2797\" width=\"491\" height=\"272\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><em>(Code for building a database of surface and underground permits)<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The certificates of granted water use are made publicly available through the website of the Minas Gerais Water Management Institute (Igam) in the state of Minas Gerais. The information is presented in hundreds of files, making it difficult to <em>download<\/em>, compile, and analyze the points of interest for the user.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In this regard, a code was developed in the R programming language for the automated collection of these documents in PDF format and for a web <em>scrapping<\/em>, extracting the necessary information in an optimized manner to build a water use database, to support licensing studies.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The code scans the documents, considering naming patterns such as: Decree, Purpose, Municipality, Location (latitude and longitude), Typology (surface or groundwater), Watercourse (when applicable), Tubular well (when applicable), Watershed, and Validity period. This way, it is possible to create an organized database that allows for continuous information updates.<\/p>\n\n\n\n<div style=\"height:50px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>","protected":false},"excerpt":{"rendered":"<p>(C\u00f3digo para constru\u00e7\u00e3o de banco de dados de outorgas superficiais e subterr\u00e2neas) Os certificados de usos outorgados s\u00e3o disponibilizados publicamente atrav\u00e9s do site do Instituto Mineiro de Gest\u00e3o das \u00c1guas (Igam) do estado de Minas Gerais. As informa\u00e7\u00f5es s\u00e3o dispostas em centenas de arquivos, dificultando o download, compila\u00e7\u00e3o e an\u00e1lise dos pontos de interesse do [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2832,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":"","_ppma_block_editor_authors":"","_links_to":"","_links_to_target":""},"categories":[71],"tags":[],"ppma_author":[1293],"class_list":["post-2795","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-inovacoes"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>WEB SCRAPPING - Clam<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/clam.com.br\/en\/web-scrapping\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"WEB SCRAPPING - Clam\" \/>\n<meta property=\"og:description\" content=\"(C\u00f3digo para constru\u00e7\u00e3o de banco de dados de outorgas superficiais e subterr\u00e2neas) Os certificados de usos outorgados s\u00e3o disponibilizados publicamente atrav\u00e9s do site do Instituto Mineiro de Gest\u00e3o das \u00c1guas (Igam) do estado de Minas Gerais. As informa\u00e7\u00f5es s\u00e3o dispostas em centenas de arquivos, dificultando o download, compila\u00e7\u00e3o e an\u00e1lise dos pontos de interesse do [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/clam.com.br\/en\/web-scrapping\/\" \/>\n<meta property=\"og:site_name\" content=\"Clam\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/clamsustentabilidade\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-08T20:26:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-07T14:46:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/clam.com.br\/wp-content\/uploads\/2025\/12\/clam-sustentabilidade.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"450\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Equipe Clam\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Marketing\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Marketing\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/\"},\"author\":{\"name\":\"Marketing\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/#\\\/schema\\\/person\\\/fa779cdde1b7a2f9c367c379d4dd10b2\"},\"headline\":\"WEB SCRAPPING\",\"datePublished\":\"2023-05-08T20:26:15+00:00\",\"dateModified\":\"2026-01-07T14:46:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/\"},\"wordCount\":191,\"publisher\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#primaryimage\"},\"thumbnailUrl\":\"\",\"articleSection\":[\"Inova\u00e7\u00f5es\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/\",\"url\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/\",\"name\":\"WEB SCRAPPING - Clam\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#primaryimage\"},\"thumbnailUrl\":\"\",\"datePublished\":\"2023-05-08T20:26:15+00:00\",\"dateModified\":\"2026-01-07T14:46:48+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#primaryimage\",\"url\":\"\",\"contentUrl\":\"\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/web-scrapping\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"In\u00edcio\",\"item\":\"https:\\\/\\\/clam.com.br\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"WEB SCRAPPING\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/#website\",\"url\":\"https:\\\/\\\/clam.com.br\\\/\",\"name\":\"Clam\",\"description\":\"Consultoria especializada em iniciativas integradas para gest\u00e3o ambiental, sustentabilidade e ESG. Com base em metodologias reconhecidas e ferramentas tecnol\u00f3gicas, a Clam atua em toda a jornada de Licenciamento Ambiental e ESG, orientando decis\u00f5es estrat\u00e9gicas com foco em oportunidades, riscos e gera\u00e7\u00e3o de valor a longo prazo.\",\"publisher\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/#organization\"},\"alternateName\":\"Sustentabilidade corporativa\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/clam.com.br\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/#organization\",\"name\":\"Clam\",\"alternateName\":\"Sustentabilidade\",\"url\":\"https:\\\/\\\/clam.com.br\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/clam.com.br\\\/wp-content\\\/uploads\\\/2025\\\/04\\\/logo-clam.svg\",\"contentUrl\":\"https:\\\/\\\/clam.com.br\\\/wp-content\\\/uploads\\\/2025\\\/04\\\/logo-clam.svg\",\"width\":175,\"height\":52,\"caption\":\"Clam\"},\"image\":{\"@id\":\"https:\\\/\\\/clam.com.br\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/clamsustentabilidade\",\"https:\\\/\\\/www.instagram.com\\\/clamsustentabilidade\\\/\",\"https:\\\/\\\/www.youtube.com\\\/@clamsustentabilidade\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/clamsustentabilidade\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/clam.com.br\\\/#\\\/schema\\\/person\\\/fa779cdde1b7a2f9c367c379d4dd10b2\",\"name\":\"Marketing\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/926b085e4487b4de4fc9631d556552e0bed5469c231f53732b458280402e68a6?s=96&d=mm&r=gf367ab5c093f2ad8c8b325efc9940296\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/926b085e4487b4de4fc9631d556552e0bed5469c231f53732b458280402e68a6?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/926b085e4487b4de4fc9631d556552e0bed5469c231f53732b458280402e68a6?s=96&d=mm&r=g\",\"caption\":\"Marketing\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/Marketing\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"WEB SCRAPPING - Clam","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/clam.com.br\/en\/web-scrapping\/","og_locale":"en_US","og_type":"article","og_title":"WEB SCRAPPING - Clam","og_description":"(C\u00f3digo para constru\u00e7\u00e3o de banco de dados de outorgas superficiais e subterr\u00e2neas) Os certificados de usos outorgados s\u00e3o disponibilizados publicamente atrav\u00e9s do site do Instituto Mineiro de Gest\u00e3o das \u00c1guas (Igam) do estado de Minas Gerais. As informa\u00e7\u00f5es s\u00e3o dispostas em centenas de arquivos, dificultando o download, compila\u00e7\u00e3o e an\u00e1lise dos pontos de interesse do [&hellip;]","og_url":"https:\/\/clam.com.br\/en\/web-scrapping\/","og_site_name":"Clam","article_publisher":"https:\/\/www.facebook.com\/clamsustentabilidade","article_published_time":"2023-05-08T20:26:15+00:00","article_modified_time":"2026-01-07T14:46:48+00:00","og_image":[{"width":800,"height":450,"url":"https:\/\/clam.com.br\/wp-content\/uploads\/2025\/12\/clam-sustentabilidade.jpg","type":"image\/jpeg"}],"author":"Equipe Clam","twitter_card":"summary_large_image","twitter_creator":"@Marketing","twitter_misc":{"Written by":"Marketing","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/clam.com.br\/web-scrapping\/#article","isPartOf":{"@id":"https:\/\/clam.com.br\/web-scrapping\/"},"author":{"name":"Marketing","@id":"https:\/\/clam.com.br\/#\/schema\/person\/fa779cdde1b7a2f9c367c379d4dd10b2"},"headline":"WEB SCRAPPING","datePublished":"2023-05-08T20:26:15+00:00","dateModified":"2026-01-07T14:46:48+00:00","mainEntityOfPage":{"@id":"https:\/\/clam.com.br\/web-scrapping\/"},"wordCount":191,"publisher":{"@id":"https:\/\/clam.com.br\/#organization"},"image":{"@id":"https:\/\/clam.com.br\/web-scrapping\/#primaryimage"},"thumbnailUrl":"","articleSection":["Inova\u00e7\u00f5es"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/clam.com.br\/web-scrapping\/","url":"https:\/\/clam.com.br\/web-scrapping\/","name":"WEB SCRAPPING - Clam","isPartOf":{"@id":"https:\/\/clam.com.br\/#website"},"primaryImageOfPage":{"@id":"https:\/\/clam.com.br\/web-scrapping\/#primaryimage"},"image":{"@id":"https:\/\/clam.com.br\/web-scrapping\/#primaryimage"},"thumbnailUrl":"","datePublished":"2023-05-08T20:26:15+00:00","dateModified":"2026-01-07T14:46:48+00:00","breadcrumb":{"@id":"https:\/\/clam.com.br\/web-scrapping\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/clam.com.br\/web-scrapping\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/clam.com.br\/web-scrapping\/#primaryimage","url":"","contentUrl":""},{"@type":"BreadcrumbList","@id":"https:\/\/clam.com.br\/web-scrapping\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"In\u00edcio","item":"https:\/\/clam.com.br\/"},{"@type":"ListItem","position":2,"name":"WEB SCRAPPING"}]},{"@type":"WebSite","@id":"https:\/\/clam.com.br\/#website","url":"https:\/\/clam.com.br\/","name":"Clam","description":"Consultoria especializada em iniciativas integradas para gest\u00e3o ambiental, sustentabilidade e ESG. Com base em metodologias reconhecidas e ferramentas tecnol\u00f3gicas, a Clam atua em toda a jornada de Licenciamento Ambiental e ESG, orientando decis\u00f5es estrat\u00e9gicas com foco em oportunidades, riscos e gera\u00e7\u00e3o de valor a longo prazo.","publisher":{"@id":"https:\/\/clam.com.br\/#organization"},"alternateName":"Sustentabilidade corporativa","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/clam.com.br\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/clam.com.br\/#organization","name":"Clam","alternateName":"Sustentabilidade","url":"https:\/\/clam.com.br\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/clam.com.br\/#\/schema\/logo\/image\/","url":"https:\/\/clam.com.br\/wp-content\/uploads\/2025\/04\/logo-clam.svg","contentUrl":"https:\/\/clam.com.br\/wp-content\/uploads\/2025\/04\/logo-clam.svg","width":175,"height":52,"caption":"Clam"},"image":{"@id":"https:\/\/clam.com.br\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/clamsustentabilidade","https:\/\/www.instagram.com\/clamsustentabilidade\/","https:\/\/www.youtube.com\/@clamsustentabilidade","https:\/\/www.linkedin.com\/company\/clamsustentabilidade\/"]},{"@type":"Person","@id":"https:\/\/clam.com.br\/#\/schema\/person\/fa779cdde1b7a2f9c367c379d4dd10b2","name":"Marketing","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/926b085e4487b4de4fc9631d556552e0bed5469c231f53732b458280402e68a6?s=96&d=mm&r=gf367ab5c093f2ad8c8b325efc9940296","url":"https:\/\/secure.gravatar.com\/avatar\/926b085e4487b4de4fc9631d556552e0bed5469c231f53732b458280402e68a6?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/926b085e4487b4de4fc9631d556552e0bed5469c231f53732b458280402e68a6?s=96&d=mm&r=g","caption":"Marketing"},"sameAs":["https:\/\/x.com\/Marketing"]}]}},"authors":[{"term_id":1293,"user_id":82,"is_guest":0,"slug":"comunicacao","display_name":"Equipe Clam","avatar_url":{"url":"https:\/\/clam.com.br\/wp-content\/uploads\/2026\/01\/perfil-02-1.jpg","url2x":"https:\/\/clam.com.br\/wp-content\/uploads\/2026\/01\/perfil-02-1.jpg"},"author_category":"1","first_name":"Equipe Clam","last_name":"","user_url":"","job_title":"","description":""}],"_links":{"self":[{"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/posts\/2795","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/comments?post=2795"}],"version-history":[{"count":0,"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/posts\/2795\/revisions"}],"wp:attachment":[{"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/media?parent=2795"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/categories?post=2795"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/tags?post=2795"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/clam.com.br\/en\/wp-json\/wp\/v2\/ppma_author?post=2795"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}