How to get the list of folder/file names from a url using shell script

Question

Here is a sample website url with a list of folders; I need to get these folder names stored using shell / bash script

try using `wget` with the recursive option? https://stackoverflow.com/a/273776/1681480 — beroe, Jul 04 '19 at 15:53

krisz · Accepted Answer · 2019-07-04T17:26:27.977

4

With GNU grep:

curl <url> | grep -oP '<a href=".+?">\K.+?(?=<)'

Mac:

curl <url> | perl -nle 'print $& while m{<a href=".+?">\K.+?(?=<)}g'

It might need some tweaking for your specific site.

edited Jul 04 '19 at 17:26

answered Jul 04 '19 at 17:19

krisz

1 Answers1