Extracting info from multipage website and between date-ranges

web-scraping

#1

I really hope that someone can help a noob like me to automate this process so that i can extract info each month from a webpage. I have tried everything but can’t make it work

I need to extract one line of table info from homepage that is multipage and i need to be able to loop this so it can type different date range each time.

This part of JSON is where the the date range for loop needs to be selected to run
(As example from 2019-03-01 to 2019-03-31)

{
  "Command": "click",
  "Target": "id=from",
  "Value": ""
},
{
  "Command": "type",
  "Target": "id=from",
  "Value": "2019-01-01"
},
{
  "Command": "click",
  "Target": "id=tom",
  "Value": ""
},
{
  "Command": "type",
  "Target": "id=tom",
  "Value": "2019-01-02"
},

Then this part is the second part where it needs to extract text from all “tr[ 1,2,3…25. ]” in “td[3]”

{
  "Command": "storeText",
  "Target": "//*[@id=\"content\"]/form/table/tbody/tr[1]/td[3]",
  "Value": "!csvLine"
},

Thing is that there is more than one page almost every time.

pagenumber is displayed on the top in this element:
<em class="gotopagebuttons">Sida 1 av 16</em>

and to go to next page this is the target:

{
  "Command": "click",
  "Target": "id=movenextBottom",
  "Value": ""
},

Even if you are on the last page “id=movenextBottom” still exist but there can be max 25 pages


#2

It’s very difficult to help without a web page link or at least a screenshot of the website.