I've been trying to work through sending a html email from mailx on a linux server. Few Notes: - I have to specify a smtp server so therefore I cannot use sendmail (This is not something I can change on my end) - I cannot install 3rd party things such as mutt. I will have to use mail or mailx - Since my mail/x version is heirloom I do not have the --append or -a (attach header options) - not sure if this helps at all but my linux distro is 7.3 (Maipo) What I've seen in most posts on stackoverflow for my case: mailx -v -S smtp=SERVER -s "$(echo -e "This is the subject\nContent-Type: text/html")" -r FROM TO Content-Disposition: inline Message-ID: User-Agent: Heirloom > mailx 12.5 7/5/10 MIME-Version: 1.0 Content-Type: text/plain; > charset=us-ascii Content-Transfer-Encoding: 7bit Hello World Try 2: So I do not want the headers printed out in the body. So I tried to remove the Content-Disposition: inline mailx -v -S smtp=SERVER -s "$(echo -e "This is the subject v2\nContent-Type: text/html\nMIME-Version: 1.0")" -r FROM TO ` > Hello World > ` Try 3: Tried flip flopping content-type and mime-version mailx -v -S SERVER -s "$(echo -e "This is the subject v3\nMIME-Version: 1.0\nContent-Type: text/html")" -r FROM TO X-Priority: 1 (Highest) Message-ID: User-Agent: Heirloom mailx > 12.5 7/5/10 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Hello World After all of this, I've tried many other adaptations of the above tries but they led to no new output. So any suggestions or ideas are gladly accepted! Please keep in mind my constraints listed above...I know they limit my options but that's out of my control. thanks for your time!

I am trying to convert delimited data format to html column table output for email printing and I am unsure how to use pipe delimiter as a separater for HTML tabular formatting. Below is what I could use if a space was a separator, but in this example I am using a pipeline (|). awk ' BEGIN { print "To: 'testemail@gmai.com'" #print "MIME-Version: 1.0" print "Content-Type: text/html" print "Subject: This is a test email" print "" print "" print "SID"; print "PID"; print "Username"; print "Database"; print "Hostname"; print "Program"; print "Connected"; print "Idle Time"; print "Query Time"; print "EST COST"; print "SEQ SCAN"; print "Query"; print "" } { print "" print ""$1""; print ""$2""; print ""$3""; print ""$4""; print ""$5""; print ""$6""; print ""$7""; print ""$8""; print ""$9""; print ""$10""; print ""$11""; print ""$12""; print "" } END { print "" } ' /home/test/test.unl | sendmail -t Inside the test.unl file is the below: 15422216|-1|dwhvo|test|pd244zax.test.corp|N/A| 10:56:53| -0:00:30|10:57:22|1045127|1|SELECT sba_sub_aux.sba_subscriber_id, sba_sub_aux.sba_id_number, sba_sub_aux.sba_matchcode, sba_sub_aux.sba_marketing, sba_su| I would like to achieve the below in table format via email.

I have a script which generates a daily report which I want to serve to the so called general public. The problem is I don't want to add to my headaches maintance of a HTTP server (e.g. Apache) with all the configurations and security implications. Is there a dead simple solution for serving one small HTML page without the effort of configuring a full blown HTTP server?

I'm building a pipeline in Snakemake to analyse some data. One of the data files I'm using is provided as supplemental data as part of [this](https://www.science.org/doi/10.1126/science.aau1043) publication. The paper is behind a paywall, but I've accessed it through my institution. The supplemental data is available publically, as I can insert [this URL](https://www.science.org/doi/suppl/10.1126/science.aau1043/suppl_file/aau1043_datas3.gz) into my browser to download it. When I use wget targetting that URL however, I receive a 403 Forbidden error. I saw that [this question](https://unix.stackexchange.com/questions/139698) raises a similar issue, but trying a few referer values doesn't seem to fix anything. Developer mode on Firefox doesn't seem to give me any more information on the download process. How can I integrate this download into my pipeline?

I have a following file:

this is a title
  
    here goes a style sheet

I need to strip the ` element from it, with sed`. Currently I use

cat test.html | sed 's/.*//'

and it works, but I don't understand how to get rid of the blank line. That is, currently the output is

here goes a style sheet

Whereas I want it to be

here goes a style sheet

For this, I tried to add \s* or \n*, using both GNU and BSD sed,

cat test.html | sed 's/.*\s*//'

cat test.html | sed 's/.*\n*//'

but this didn't help. What I'm doing wrong? **Edit:** The `` line doesn't have to be on a separate line. That is, sometime the whole file can be just a single line:

this is a titlehere goes a style sheet

In such a case, the desired output is

here goes a style sheet

While I have seen several questions similar to the one I am going to ask, for example, https://unix.stackexchange.com/questions/275370/how-can-i-convert-all-the-html-files-i-get-into-text-files-after-a-wget-command/ I also saw a blog post which describes it and have seen it works.  I tried it even locally and found even that works but in local files i.e. files which are residing say in some /usr/share/doc/$PACKAGENAME/index.html and number of pages linked therein, there should be an easier way to get at least the top page. I tried doing something like: html2text file:///usr/share/doc/$PACKAGENAME/html/index.html > packagename-doc.txt but that didn't work.  I get the output: Cannot open input file "file:///usr/share/doc/$PACKAGENAME/html/index.html". I am not giving any package names as it doesn't really matter and there are so many packages nowadays that give documentation in HTML pages rather than man or info, but that's outside the topic altogether. Can somebody either tell why or give an alternative way of doing it, either via html2text or some other tool that does it in a simple way?

having a dilemma with downloading webpages and converting them to markdown, for example: F=$(curl -O --silent https://www.guru3d.com/story/msi-teases-spatium-m560-ssd-with-innovative-nonmetallic-vc-cooling-technology | pandoc --extract-media="./"${F%.*}"_media" --from html --to markdown_strict -o "${F%.*}.md") HTML file downloads fine but the md file that gets created is not given proper name and is of no content. What is wrong in this syntax? Is there maybe some better or easier way of downloading webpages, converting them to markdown and storing html page images locally?

Actually on my network infrastructure, we have many Layer 2 & layer 3 devices and network admins work a lot on that. I have an Ubuntu 20.04 LTS, and i installed apache2 on it. I wanted to know how I can ssh on my devices using any browser. For e.g, I browse to my server IP from a computer on the network, on the html page there will be a list of devices, I'll select one and SSH directly on it. Do you have any idea.

I want to be able to handle any type of content stored into the bash variable ${CONTENT}, to be used as sed replacement text into another content, no matter if there are quotation marks, single quotes or other special characters that an HTML file with CSS can have, without needing to create temporary files. CONTENT=$(cat "${HTML_FILE}") HTML=$(cat "parent_file.html" | tr -d '\n' | sed -E "s/(]*>).*()/\1\n${CONTENT}\n\2/") But this will error out with an error like: sed: -e expression #1, char XXX: unterminated `s' command Is what I'm asking for even possible?

I tried the options in https://unix.stackexchange.com/questions/662801/is-there-a-script-or-tool-that-converts-html-to-pdf with command: pandoc documentation.html -o test.pdf --pdf-engine=xelatex but unfortunately they do not preserve the CSS formatting. For example I have this document that looks like this : --- but the resulting pdf output looks plain like this without css formatting. Notice that the header with blue background is gone and all the other formatted texts no background css.

Is it possible to mail an html file that looks exactly like the second image? I know

-e 'set content_type="text/html"' -s "Subject" user@email.com < test.html

works but it sends the html (first image) without the css or "design".

Consider my humble _hello.html_ file, edited with mighty ed:

$ ed hello.html 
28
,p
Hello world!

What's your general approach to edit inside that *title* HTML tag (bonus if you can edit inside any HTML tag)? I tried a regular expression that matches inside the tag:

s/>.*/>My new title/p
My new title
u
.
Hello world!

But, sadly, you can see that I chopped my tag (and it would be way too much work to type out that _``_ bit every time!). For further education, I browsed through Software Tools in Pascal page to 174—see https://archive.org/details/softwaretoolsinp00kern/page/174/mode/1up?view=theater page—and discovered the _&_ special character that helpfully reaches the _middle_ of the sentence:

s/world/& again/p
Hello world again!

But, that's not quite right, since I want to substitute the middle, not just reach the middle.

I would like to add annotations (such as underlines, text comment, circle or square a text region, ...) to downloaded html files. Is there some WYSIWYG html annotation tool (for Linux) for that purpose? Not sure if browsers can. Chrome web browser seems not able to? Not sure about Firefox. Not sure if non-browsers can. Thanks.

I'm trying to parse an HTML page with [pup](https://github.com/ericchiang/pup) . This is a command-line HTML parser and it accepts general HTML selectors. I know I can use Python which I do have installed on my machine, but I'd like to learn how to use pup just to get practice with the command-line. The website I want to scrape from is https://ucr.fbi.gov/crime-in-the-u.s/2018/crime-in-the-u.s.-2018/topic-pages/tables/table-1 I created an html file:

curl https://ucr.fbi.gov/crime-in-the-u.s/2018/crime-in-the-u.s.-2018/topic-pages/tables/table-1  > fbi2018.html

How do I extract out a column of data, such as 'Population'? This is the command I originally wrote:

cat fbi2018.html | grep -A1 'cell31 ' | grep -v 'cell31 ' | sed 's/text-align: right;//' | sed 's///' | sed 's/--//' | sed '/^[[:space:]]*$/d' | sort -nk1,1

It actually works but it's an ugly, hacky way to do it, which is why I want to use pup. I noticed that all of the values I need from the column 'Population' have headers="cell 31 .." somewhere within the `` tag. For example:

323,405,935

I want to extract all the values that have this particular header in its ` tag, which in this particular example, would be 323,405,935` It seems that multiple selectors in pup doesn't work, however. So far, I can select all the td elements:

cat fbi2018.html | pup 'td'

But I don't know how to select headers that contain a particular query. **EDIT:** The output should be:

272,690,813
281,421,906
285,317,559
287,973,924
290,788,976
293,656,842
296,507,061
299,398,484
301,621,157
304,059,724
307,006,550
309,330,219
311,587,816
313,873,685
316,497,531
318,907,401
320,896,618
323,405,935
325,147,121
327,167,434