Softpanorama

May the source be with you, but remember the KISS principle ;-)
Contents Bulletin Scripting in shell and Perl Network troubleshooting History Humor

Perl Web Site Management Scripts

News See also Recommended Links Global Replacement What's new generators Sitemap/index generators
Upload
download
WebSite monitoring Perl Wiki Mirroring Tools Problem tracking Table of content generators
Perl HTTP Logs Processing Scripts Dead Links Checkers Cheap Web hosting with SSH access Sysadmin Horror Stories  Humor Etc

 Web site is a tough mistress and tools are important in order to be able to keep your head above the water. Other things equal Perl scripts are most transparent and modifiable.

NEWS CONTENTS

Old News ;-)

[Jul 16, 2008] sitecopy 0.16.5 by Joe Orton

About: sitecopy allows you to easily maintain remote Web sites. The program will upload files to the server which have changed locally, and delete files from the server which have been removed locally, keeping the remote site synchronized. FTP and WebDAV are supported.

Changes: This release updates the bundled version of neon and fixes a bug in SSL certificate caching. A new mailing list is available.

[Dec 20, 2006] CGI-Shell

freshmeat.net

CGI-Shell provides a shell using CGI, so everyone who has a CGI directory on a Web server can also have a shell on it. It's comparable to telnet or SSH.

Web-Absence

Web-absence is a CGI application designed to help keep track of people in a group. It is intended to do one thing: allow the user to display the plans of all people in a group in a way that makes it easy to see who's present and who's absent. It is not intended for anything else. The resolution is one day.

You may remember a Tcl (yuck) application with a similar name from some years ago...

It could easily be adapted do handle reservations for any set of objects, as long as a resolution of a day is acceptable.

An example of a possible use is reserving machines/computers in a laboratory.

Web-absence is based on four Perl CGI-scripts that rely on seven back-end Perl modules written specifically for web-absence. For each month, an image (by default, PNG) is generated. Absences are created, edited, and deleted by clicking on the month-image.

Absence can be configured to use one of two modes to handle absence manipulations, server-side or client-side image maps.

Stunnix Perl Web Server

Developed for writing browser-based applications and database-driven catalogues or presentations that reside on CDROM or DVD, internally implemented as Perl-driven or PHP-driven Web sites that store data in a database also located on CDROM. It produces a single CD that works on Windows, Mac OS X, and Linux/x86, without requiring any additional software on the user's computer. All an author needs to do to build a cross-platform browser-based application or CDROM is to copy scripts to their proper directories. HTML::Mason and mod_perl-like execution modes are supported for Perl-driven Web sites. *Changes:* A Web site can be automatically opened in MSIE in kiosk mode on Windows upon startup of the Web server. Support for PHP on Mac OS X has been fixed. Support for using the default browser on Windows has been fixed.

Project details for Dispair

freshmeat.net

Dispair (DISPlay Archives In Realtime) is a tiny CGI-script written in Perl that lets users browse tar.gz archives.

Five quick hacks to download the Web

Hexcol (Perl) Simple perl 5 script to calculate hex notation for web colors.

Elsop Webmaster Resource Center

a comprehensive site of software, site mappers, link validators, trade associations, computer law, webmaster humor, training, site development services, and more.

Linklint

Written in Perl.

A fast, html link checker shareware package. This is a total rewrite of Rick Jansen's webxref, by Jim Bowlin. Written in Perl. Checks local files, remote sites, and remote links. Good documentation.

ScriptSearch

a huge catalog of contributed scripts you can use for Web development. Lots of samples in Perl, Java, JavaScript, Tcl, Shell, Applescript, VB, C/C++ and other languages. Well organized. WebPages 1.0 WebPages is a CGI script written in Perl

Can centralize all pages from several web servers containing this script, and merge them all into one page. It is especially useful for distributed sites that hold personal pages.

webgrep

Alternate Download: http://www.oche.de/~bearix/g/webgrep-1.7.tar.gz

Red Hat Packages: http://www.linuxfocus.org/~guido.socher/webgrep-1.6-1.i386.rpm

Homepage: http://www.linuxfocus.org/~guido.socher/

webgrep is a set of 7 different check and search utilities for the web-master.

[April 16, 1999] Proxy Caching -- parameters using in caching


Recommended Links

Softpanorama hot topic of the month

Softpanorama Recommended

Top articles

Sites

Helpful Administrative Scripts


What's new generators

site-dater.pl

Igor - February 16th 1999, 13:51 EST

urls
Download: http://www.life.uiuc.edu/igorl/ISL/Programming_projects/distrib/site-dater.tar.gz
Homepage: http://www.life.uiuc.edu/igorl/ISL/Programming_projects/Previous_projects.html#site-dater

site-dater.pl is a short script which will scan a web hierarchy and generate a table of web links (sorted by modification date) within that hierarchy.

WhatsNew/README.txt, 8611 bytes
WhatsNew/WhatsNew.cfg, 2966 bytes
WhatsNew/WhatsNew.pl, 16525 bytes
WhatsNew/WhatsNewFooter.pl, 716 bytes
WhatsNew/WhatsNewHeader.pl, 397 bytes


Global Replacement

 

sarep (Console/Editors) Command-line search and replace tool written in Perl.
Sep 16th 1998, 21:51 stable: 0.32 - devel: none - license: freely distributable

replacer.pl (Perl) A utility to replace all instances of a given text string with a new text string in all the files in a single directory.

Treesed -- Freeware
Treesed, a Perl program, is a search/replace tool for lists of files. It can search for patterns in a list of files, or even a tree of directories with files.

Usage:
treesed pattern1 <pattern2> -files <file1 file2 ...>
treesed pattern1 <pattern2> -tree

Treesed searches for pattern1. If pattern2 is supplied pattern1 is replaced by pattern2. If pattern2 is not supplied treesed just searches. A list of files can be supplied with the -files parameter. Treesed is also capable of search/replace in files in subdirectories if you supply the -tree parameter. All files in the current directory and subdirectories are processed. Always a backup is made of the original file, with a random numeric suffix.

 

 


Sitemap generator

tree.pl creates a sitemap for all kinds of files (e.g., HTML and image files). It follows the directory structure on disk, creating a nested HTML list that contains the files' names or (in case of HTML) their titles, their last modified date, and their size. tree.pl can be used as a normal commandline application or as a CGI script.


Upload/download

HotScripts.com CGI and Perl File Manipulation @1 File Upload & Download Manager

File Managements - Upload perl cgi scripts

Mega Upload -- Perl File Upload with Progress bar

FileUpload - Module for HTTP File Uploading.

[June 24, 1999] Five quick hacks to download the Web

This script allows people using browsers that are RFC1867 compliant to upload and download files directly from the web.

Language: Perl Platform: Unix, Windows

View Product Homepage

Download Complete Source Code, 0.010M bytes

Click file name to view online:
upload.pl, 10270 bytes
file.gif, 923 bytes
folder.gif, 916 bytes

File Upload version 6.0

This script allows Netscape users to enter a name for the file to be saved as, and then select a file on your computer to be uploaded to a WWW server. Administrators can configure which directory they will allow files to be uploaded inside the script to prevent tampering. This script is ideal for admin's who want to allow users to upload files, but don't want to issue separate telnet accounts or teach their users the ways of FTP.

Language: Perl Platform: Unix, Windows

View Product Homepage

Download Complete Source Code, 0.058M bytes

Click file name to view online:
file-upload.cgi, 13326 bytes
README, 14017 bytes
upload.html, 1669 bytes

www.pl


Perl library that allows your scripts to access and retrieve files through HTTP.

Language: Perl Platform: Unix

View Product Homepage

Download Complete Source Code, 0.013M bytes

Click file name to view online:
www.pl, 34818 bytes

Webget version 1.0

Given a URL on the command line (HTTP and FTP supported at the moment), webget fetches the named object (HTML text, images, audio, whatever the object happens to be). Will automatically use a proxy if one is defined in the environment, follow "this URL has moved" responses, and retry "can't find host" responses from a proxy in case host lookup was slow. Supports users & passwords (FTP), Basic Authorization (HTTP), update-if- modified (HTTP), and much more. Works with perl4 or perl5.

Language: Perl Platform: Unix, Windows

View Product Homepage

Download Complete Source Code, 0.042M bytes

Click file name to view online:
webget.pl, 43942 bytes


Dead Link Checkers

Dead Link Check 0.3 Martial MICHEL Wed Jul 21 14:37:18 EST 1999
Dead Link Check (DLC) is a Perl script designed to find information on validity of HTTP references. The script may use/generate a cache file for avoiding redoing network requests if the user want to check added entries. The script works by reading entries from a file (or a list of links from the command line) and output results in file(s) (or STDOUT). DLC was created as an extension to Public Bookmark Generator (PBM), but can be used by itself.

Release Notes:
Extended range of user redirection recognition. Adding an optional argument to the "later" option. Extended handling of ftp requests. Added "indicator" option for having a progress indicator (in percent) if running in maximum verbose mode. Extended code so that "Bad Host Names" are not network requested more than required. Option "userRedirect" now as the same effect as forcing a "GET". Extended return codes to HTTP/1.1 range (using RFC 2616). Bug fix in http to ftp redirect. (see changelog)

Download: http://www.loria.fr/~michel/DLC/dlc-0.2.1.tar.gz
Homepage: http://www.loria.fr/~michel/DLC/
Changelog: http://www.loria.fr/~michel/DLC/CHANGES

Dead Link Check (DLC) is a Perl script designed to find information on validity of HTTP references. The script may use/generate a cache file for avoiding redoing network requests if the user wants to check added entries. The script works by reading entries from a file (or a list of links from the command line) and output results in file(s) (or STDOUT). DLC was created as an extension to Public Bookmark Generator (PBM), but can be used on its own.


Version control


Table of contents generators

htmltoc

htmltoc documentation

htmltoc (Perl) htmltoc is a Perl program to generate a Table of Contents (ToC) for HTML documents.


Problem tracking

See also Web-based problem tracking tools for Unix


Random Findings

Catalog
Loic Dachary - February 01st 1999, 11:54 EST

Download: http://www.senga.org/download.html
Mirror List: http://www.perl.com/CPAN/modules/by-module/Catalog/
Homepage: http://www.senga.org/
Changelog: http://www.senga.org/Catalog/current/ChangeLog

Catalog allows to build and maintain Yahoo! style catalogs. It includes a browsing interface and an easy to use template system for customization of the HTML pages. It is fully documented and distributed under the GNU General Public Licence. Catalog is also included in CPAN.

VelociGen for Perl (VEP) 1.0c
VelociGen for Perl is a high performance web application server using Perl as its programming language. It features CGI compatible mode, allowing you to speed up your existing CGI scripts by as much as 20 times without modifying your existing code, as well as embedded mode which allows you to embed Perl code within your html pages, resulting in dynamic, template based pages. Standard Perl extentions can be used to access databases, create images on the server, and much more. The Linux version is free for non-commercial use.

This release has been updated to work with Apache 1.3.3. It is available for both Libc5 and Glibc based systems.

Fish Head @ 11/11/98 - 15:39 EST

Net::DNS version 0.12
Net::DNS is a Perl interface to the DNS resolver. It allows the programmer to perform any type of DNS query from a Perl script.

Language: Perl Platform: Unix

View Product Homepage

Download Complete Source Code, 0.090M bytes


Etc

Crnuke (Perl)
Reduce the size of your web pages with basic HTML compression using crnuke.



Etc

FAIR USE NOTICE This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of environmental, political, human rights, economic, democracy, scientific, and social justice issues, etc. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit exclusivly for research and educational purposes.   If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner. 

ABUSE: IPs or network segments from which we detect a stream of probes might be blocked for no less then 90 days. Multiple types of probes increase this period.  

Society

Groupthink : Two Party System as Polyarchy : Corruption of Regulators : Bureaucracies : Understanding Micromanagers and Control Freaks : Toxic Managers :   Harvard Mafia : Diplomatic Communication : Surviving a Bad Performance Review : Insufficient Retirement Funds as Immanent Problem of Neoliberal Regime : PseudoScience : Who Rules America : Neoliberalism  : The Iron Law of Oligarchy : Libertarian Philosophy

Quotes

War and Peace : Skeptical Finance : John Kenneth Galbraith :Talleyrand : Oscar Wilde : Otto Von Bismarck : Keynes : George Carlin : Skeptics : Propaganda  : SE quotes : Language Design and Programming Quotes : Random IT-related quotesSomerset Maugham : Marcus Aurelius : Kurt Vonnegut : Eric Hoffer : Winston Churchill : Napoleon Bonaparte : Ambrose BierceBernard Shaw : Mark Twain Quotes

Bulletin:

Vol 25, No.12 (December, 2013) Rational Fools vs. Efficient Crooks The efficient markets hypothesis : Political Skeptic Bulletin, 2013 : Unemployment Bulletin, 2010 :  Vol 23, No.10 (October, 2011) An observation about corporate security departments : Slightly Skeptical Euromaydan Chronicles, June 2014 : Greenspan legacy bulletin, 2008 : Vol 25, No.10 (October, 2013) Cryptolocker Trojan (Win32/Crilock.A) : Vol 25, No.08 (August, 2013) Cloud providers as intelligence collection hubs : Financial Humor Bulletin, 2010 : Inequality Bulletin, 2009 : Financial Humor Bulletin, 2008 : Copyleft Problems Bulletin, 2004 : Financial Humor Bulletin, 2011 : Energy Bulletin, 2010 : Malware Protection Bulletin, 2010 : Vol 26, No.1 (January, 2013) Object-Oriented Cult : Political Skeptic Bulletin, 2011 : Vol 23, No.11 (November, 2011) Softpanorama classification of sysadmin horror stories : Vol 25, No.05 (May, 2013) Corporate bullshit as a communication method  : Vol 25, No.06 (June, 2013) A Note on the Relationship of Brooks Law and Conway Law

History:

Fifty glorious years (1950-2000): the triumph of the US computer engineering : Donald Knuth : TAoCP and its Influence of Computer Science : Richard Stallman : Linus Torvalds  : Larry Wall  : John K. Ousterhout : CTSS : Multix OS Unix History : Unix shell history : VI editor : History of pipes concept : Solaris : MS DOSProgramming Languages History : PL/1 : Simula 67 : C : History of GCC developmentScripting Languages : Perl history   : OS History : Mail : DNS : SSH : CPU Instruction Sets : SPARC systems 1987-2006 : Norton Commander : Norton Utilities : Norton Ghost : Frontpage history : Malware Defense History : GNU Screen : OSS early history

Classic books:

The Peter Principle : Parkinson Law : 1984 : The Mythical Man-MonthHow to Solve It by George Polya : The Art of Computer Programming : The Elements of Programming Style : The Unix Haterís Handbook : The Jargon file : The True Believer : Programming Pearls : The Good Soldier Svejk : The Power Elite

Most popular humor pages:

Manifest of the Softpanorama IT Slacker Society : Ten Commandments of the IT Slackers Society : Computer Humor Collection : BSD Logo Story : The Cuckoo's Egg : IT Slang : C++ Humor : ARE YOU A BBS ADDICT? : The Perl Purity Test : Object oriented programmers of all nations : Financial Humor : Financial Humor Bulletin, 2008 : Financial Humor Bulletin, 2010 : The Most Comprehensive Collection of Editor-related Humor : Programming Language Humor : Goldman Sachs related humor : Greenspan humor : C Humor : Scripting Humor : Real Programmers Humor : Web Humor : GPL-related Humor : OFM Humor : Politically Incorrect Humor : IDS Humor : "Linux Sucks" Humor : Russian Musical Humor : Best Russian Programmer Humor : Microsoft plans to buy Catholic Church : Richard Stallman Related Humor : Admin Humor : Perl-related Humor : Linus Torvalds Related humor : PseudoScience Related Humor : Networking Humor : Shell Humor : Financial Humor Bulletin, 2011 : Financial Humor Bulletin, 2012 : Financial Humor Bulletin, 2013 : Java Humor : Software Engineering Humor : Sun Solaris Related Humor : Education Humor : IBM Humor : Assembler-related Humor : VIM Humor : Computer Viruses Humor : Bright tomorrow is rescheduled to a day after tomorrow : Classic Computer Humor

The Last but not Least


Copyright © 1996-2016 by Dr. Nikolai Bezroukov. www.softpanorama.org was created as a service to the UN Sustainable Development Networking Programme (SDNP) in the author free time. This document is an industrial compilation designed and created exclusively for educational use and is distributed under the Softpanorama Content License.

The site uses AdSense so you need to be aware of Google privacy policy. You you do not want to be tracked by Google please disable Javascript for this site. This site is perfectly usable without Javascript.

Original materials copyright belong to respective owners. Quotes are made for educational purposes only in compliance with the fair use doctrine.

FAIR USE NOTICE This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available to advance understanding of computer science, IT technology, economic, scientific, and social issues. We believe this constitutes a 'fair use' of any such copyrighted material as provided by section 107 of the US Copyright Law according to which such material can be distributed without profit exclusively for research and educational purposes.

This is a Spartan WHYFF (We Help You For Free) site written by people for whom English is not a native language. Grammar and spelling errors should be expected. The site contain some broken links as it develops like a living tree...

You can use PayPal to make a contribution, supporting development of this site and speed up access. In case softpanorama.org is down you can use the at softpanorama.info

Disclaimer:

The statements, views and opinions presented on this web page are those of the author (or referenced source) and are not endorsed by, nor do they necessarily reflect, the opinions of the author present and former employers, SDNP or any other organization the author may be associated with. We do not warrant the correctness of the information provided or its fitness for any purpose.

Last modified: September 12, 2017