git://git.nikiroo.be / gofetch.git / blame
| Commit | Line | Data |
|---|---|---|
| 73785268 | 1 | # GoFetch |
| 73785268 | 2 | GoFetch is a simple web scrapper that outputs gopher-ready files. |
| 13229d5b NR |
3 | |
| 4 | ## Synopsis | |
| 5 | ||
| 6 | ```gofetch``` [*dir*] [*selector*] [*type*] [*max*] [*hostname*] [*port*] | |
| 7 | ||
| 8 | ## Description | |
| 9 | ||
| 10 | You point the program to your gopher directory, you launch it, and you have a | |
| 73785268 NR |
11 | gopher view of the supported news sites. |
| 12 | ||
| 13229d5b NR |
13 | The program will also helpfully create a ```gophermap``` and an ```index.html``` page for each supported website, as well as a general page to link to all the subpages (*selector*/```gophermap``` and *selector*/```index.html```). |
| 14 | ||
| 15 | ### Supported websites | |
| 73785268 NR |
16 | |
| 17 | - Slashdot: News for nerds, stuff that matters! | |
| 13229d5b NR |
18 | - LWN: Linux Weekly Newsletter |
| 19 | - Le Monde: Actualités et Infos en France et dans le monde | |
| 20 | - The Register: Biting the hand that feeds IT | |
| 21 | - TooLinux: Actualité généraliste sur Linux et les logiciels libres | |
| 22 | - Ère Numérique.FR: faites le bon choix ! | |
| 23 | - Phoronix: news regarding free and open-source software | |
| 73785268 | 24 | |
| 13229d5b | 25 | ### Supported platforms |
| 73785268 NR |
26 | |
| 27 | Any platform with at lest Java 1.6 on it should be ok. | |
| 28 | ||
| 13229d5b | 29 | ## Options |
| 73785268 | 30 | |
| b7f5700d NR |
31 | You can start the program via the script or directly with ```java```: |
| 32 | ||
| 13229d5b NR |
33 | - ```gofetch``` [*dir*] [*selector*] [*type*] [*max*] [*hostname*] [*port*] |
| 34 | - ```java -jar gofetch.jar``` [*dir*] [*selector*] [*type*] [*max*] [*hostname*] [*port*] | |
| 73785268 | 35 | |
| b7f5700d NR |
36 | The options are: |
| 37 | ||
| 13229d5b NR |
38 | - *dir*: the target directory where to store the files |
| 39 | - *selector*: the gopher selector to prepend (also a sub-directory in [dir]) | |
| 40 | - *type*: the supported website (see the ```Supported websites``` section) in upper case or the special keyword ```ALL``` for all of them | |
| 41 | - *max*: the maximum number of stories to show on the main page | |
| 42 | - *hostname*: the gopher hostname | |
| 43 | - *port*: the gopher port | |
| 73785268 NR |
44 | |
| 45 | ## Compilation | |
| 46 | ||
| 47 | ```./configure.sh && make``` | |
| 48 | ||
| 49 | You can also import the java sources into, say, [Eclipse](https://eclipse.org/), and create a runnable JAR file from there. | |
| 50 | ||
| 13229d5b | 51 | #### Dependant libraries (included) |
| 73785268 NR |
52 | |
| 53 | - libs/nikiroo-utils-sources.jar: some shared utility functions I also use elsewhere | |
| 54 | - [libs/jsoup-sources.jar](https://jsoup.org/): a nice library to parse HTML | |
| 55 | ||
| 56 | Nothing else but Java 1.6+. | |
| 57 | ||
| 58 | Note that calling ```make libs``` will export the libraries into the src/ directory. | |
| 59 | ||
| 13229d5b NR |
60 | ## Author |
| 61 | ||
| 62 | GoFetch was written by Niki Roo <niki@nikiroo.be> | |
| 63 |