C4U

Check4Update - Resource Monitoring



Home

FAQ
Screenshots
Credits
Sourceforge
Changelog
ToDo

 
 
ChangeLog
==================================================
C4U V0.5.4
==================================================
PHP INTERFACE:
--------------
[+] Adding Content-Encoding gzip support
[*] Migration to JavaScript, DHTML Tooltips version 3.36
[*] Migration to Apache Axis 1.3
[+] Displaying full resource title in browser title-bar in diff view
[#] User account was accidentally disabled if the user password
    was changed via GUI

SERVER COMPONENTS:
------------------
[+] Migration of the SOAPInterface to use the jSoapServer
    library instead of the old modified SimpleSoapServer
[*] Migration to http-client 3.0-rc4    
[*] Migration to jSch 0.1.24

NOTIFICATION MODULE:
--------------------
[+] Now it's possible to configure that C4U should reset
    the modification counter of a resource after the 
    notification message was sent to the user

==================================================
C4U V0.5.3 [2005-11-23]
==================================================
PHP INTERFACE:
--------------
[+] Resource Enty Diff WebPage modified
    Now the Diff page provides additional informations of the
    resource like the resource favicon, name, link, date and
    links to view the old and the new version of the comparison.
    
[+] Migration to wz_tooltip.jsversion 3.28

OTHER THINGS:
--------------
[+] Create User function changed:
    Now a set of default resources will be created for each
    newly registered user.
    
[#] Processing Timestamp of a resource was not calculated correctly
    when using a very large interval (e.g. 30 days).
    
[+] Server Shutdown improved     
    Now all remaining Notification Messages will be send on Server
    shutdown
    
[+] Adding jMimeMagic matcher pattern to detect rss/atom feeds
    without the need to use the informa FormatDetector class        

[*] Migration to use PDF-Box Version 0.7.1

[*] Replacing all Arrays.asList(new Object[]{obj1,obj2}) occurences with
    Arrays.asList(obj1,obj2)
    This is possible because of a new Java 5.0 feature.

==================================================
C4U V0.5.2 [2005-03-18]
==================================================
PHP INTERFACE:
--------------
[#] SOAP Method calls corrected
    Type casts were not done in all situations.
    This change was needed because of a new XML
    parser on the C4U server.
    
[#] QuickAddBookmark 
    function has not inserted all needed resource settings
    into the database correctly.  
    
[*] Migration to JavaScript Tooltip Library 3.27       

{+] LastModfied Page changed
    Now the lastModified page also shows the resource entries
    and the link + diff + clear icon for each entry.
    
[+] ResourceEntry Configuration:
    "Save and Return" button added.
    
[+] Criteria Configuration:
    "Save and Activate" button added.    
    
[#] Change Resource Query settings
    query status was not displayed correctly. fixed
    
[+] Resource Difference Page Changed.
    Now a link will be displayed for each href tag found in
    the difference highlighting of a resource content.
    With this modification it's easier to follow a new link
    that was inserted into a monitored webpage.    
    
CONVERSION MODULES:
-------------------    
[+] Lha Support added

[*] Conversion Modules now return a ContentConversionResult
    Object instead of a String Array. This allows to add 
    additional features like a mimeType specific Title 
    detection, etc.
    
[+] RSS Converter Module
    new RSS Converter Module added. This module was needed
    because of RSS title/description extraction.
    
HARVESTER MODULES:
-------------------    
[+] HTTP Module / Detection of Dynamic Content
    From now on it's configureable if the http harvester
    module should try to detect dynamic content. This is now
    configureable because sometimes a webpage doesn't allow
    to download the same page twice withing a given timespan.
    With this option the detection can now be disabled if needed.
    
[*] Migration to HttpClient 3.0 RC1
	Most interesting changes in HttpClient: ...
	33021 - Fixed the bug causing the circular redirect if different query parameters
           are used in the redirect location.
           Contributed by Ilya Kharmatsky 
    
[#] Email Harvester / Illegal Email address problem fixed
    If a message was send from an email address with an illegal format an Exception
    was thrown. We now set the address to "unknown".    
    
INSPECTION MODULES:
-------------------
[+] HTML-Inspection: only visible parts inspection
	Support of Inspection mode where only the
	visible parts of the homepage will be compared.
	
[#] Dynamic Element handling changed
    Dynamic Elements were not removed correctly from
    the xhtml document of a webpage. This problem
    is fixed now.
    Additionally there was a problem with attribute
    nodes which have no parent node (see spec.
    http://www.w3.org/TR/DOM-Level-2-Core/core.html#ID-637646024)
    and therefore could not be removed easily. In
    this case C4U simply set's the value of such an
    dynamic node to null.
    
[#] Rss Feed Inspection Problem fixed
    C4U had problems with RSS feeds containing no items. This bug
    is fixed now.
    
NOTIFICATION MODULES:
---------------------
[+] RSS Support added
    Migration of the old PassiveRssNotifier Module.
    
[+] Passive Notifier Threadpool implemented
    Now we use a Threadpool for passive Notifications.    
       
OTHERS:
-------------------       
[#] Clear Entry Notification Flag Bugfix
    Function didn't work correctly for resources with
    multiple modified entries.    

==================================================
C4U V0.5
==================================================

PHP INTERFACE:
--------------
[+] Archiv Copy / CSS
    Now external stylesheet files for html resources
    will also be stored as part of the archiv copy
    to make achieve layout.
    
[+] HTML Content / Base URL
    Adding base url to a html formatted content to
    allow the browser to view the embedded links 
    correctly.
    
[#] Archiv Copy / Mime Type
    The corrent content mime type is now used on the 
    webinterface.

[#] Extract Title from Website Bugfix
    Title tag which goes over multiple lines was not
    detected correctly
    
[#] Archiv Copy Frameset Bugfix
    Frameset frame src attribute was not detected
    correctly when frame definition goes over 
    multiple lines.

[#] Difference Highlighting Bugfix
    Some errors in html table structure corrected

[+] Resource Diff / Entry Part support
    If a resource entry contains multiple parts
    (e.g. for framesets) then a list of the availabe
    parts will be displayed when the user clicks on
    the entry diff symbole.   
    
[#] Archiv Copy View / Port Bug
    TCP/IP Port was not set correctly for the rewritten 
    links (e.g. links to frames or stylesheets)
    
[#] NF / Resource / Criteria Config Dialog Bugfix
    Exception if configuration option with only
    supoptions
    
[#] RSS Content View - Image size bug fixed
    Feed Image was not views correctly    
    
[+] Res./Nf/Criteria Configuration - FadeOut 
    Fadeout feature added to the configuration 
    dialogs. Now it's possible to fade out 
    unimportant configuration dialog parts.
            

CONTENT CONVERSION MODULES:
---------------------------
[#] PDFBox usage bugfix
    PDF Document object is now closed correctly
    
[*] Magration to jmimemagic-0.0.4a
    to allow a better detection of the mime type
    of a downloaded content. 
    
[+] Support for gzip files added
    Now the uncompressed content is inspected instead
    of the compressed bytestream.    
    
[+] Support for tar files added
    Now the directory structure (much like as for zip)
    is inspected instead of the bytestream.   
    
[+] Migration of content mime type detection done.
    Now a mimeType detection if the mime type was
    reported as 'text/plain' by the webserver. This
    is needed to detect relatively unknown text based
    mime types, e.g. 'text/calendar' files.     
    
[+] Adding support for Java Classfiles
    Now the java class interface description is used
    for inspection instead of the bytestream.    
    
[*] Migration to new PDFBox version 0.7
    because of performance improvements
    
NOTIFICATION MODULES:
---------------------------    
[#] ICQ Bugfix 
    to avoid raceconditions     
    
    
HARVESTER MODULES:
---------------------------     
[+] HTTP Authentication
    Support of HTTP Authentication added.
    TODO: what happens if two different users access the
          same url with different login info at the same 
          time?
    
[#] Loop detection for Framesets added
    Self References of Frames will now be detected 
    by the HttpHarvester to avoid download Loops.  
    
[#] Http Authentication Configuration Bugfix
    DB configuration was not corrected after
    introducing the http auth feature. 
    Therefore the http authentication was not
    configureable for already existing entries.
    This is corrected now.

[*] Migration to JSch 0.1.19

[*] Migration of HttpHarvester
	Migration to use Apache httpClient now.
	Advantages:
	- better support for http Authentication
	- better https support (self signed Certificates)	


INSPECTION MODULES:
--------------------------- 

[+] Criteria Of Change Support for Text/Keywords added
    Now it's possible to specify a Keyword or Regular
    expression that should be used to inspect the entry
    content for changes.
    Additional Options will follow.

[+] Google Diff / Inspection migrated
    Google Harvester now stores the search results as 
    XML. Therefore the Inspection Module was migrated
    to convert these XML structure to HTML for Displaying
    at the gui.
    The advantage the new XML format is, that the comparison
    of the search results is more easy. This is one pre-
    requirement for the introduction of Criteria of Change
    for a Goolge Search Result Content (Will follow).

[#] Now using the correct Inspection Module for 
    Content Diff + Archiv Copy View
    We only had used the HTMLInspector Module for
    all Resources. Now we use the proper ones. This is
    needed e.g. to support the proper displaying of a
    google resource.

[+] Migration of RSS Support
    Using Informa Package now to provide a better
    rss support not. 
    Additionally the Display function for the RSS
    was migrated to view a html formated page now
    instead of the xml document. The Diff function
    was also reimplemented to support html format
    now.

[+] Adding source code highlighting ...
    to display the content of java source files or
    java class files (in combination with the new
    feature above) with syntax highlighting.
    Currently I'm using the package Java2Html for 
    this. 

[+] icalendadar support added
    now it's possible to buildup a reminder by 
    setting y timespan in the criteria of change
    dialog for the iCalendar. If C4U detects
    a new event within the next x days, the a
    notification message will be send.    
    
[*] migration of keyword criterias to use the 
    apache lucene package now. This allows to
    enter a more complexe query and to query
    using various fields (e.g. for google) 
    without a complex to handle configuration
    dialog.
    
[*] iCalendar Inspection migrated to use
	a special inspection based on the UID
	and sequence numbers of the calendar
	entries now instead of a simple
	textbased inspection.  
	
[+] Support for dynamic html content
	Now C4U has the possibility to detect dynamic html
	elements automatically. This elements can then be
	ignored using the proper html-content criteria
	of change settings.
	Therefore it should now be possible to check pages
	containing counters, banners, date/time strings etc.	  
    
OTHERS:
---------------------------     
[+] Archiv Copy count restricted to 20 copies per entry
    To free storage space C4U only keeps a maximum of
    20 entry copies for each entry. 
    TODO: make this configureable in further versions

[+] Resource Content Search Engine added
    Now the user has the possibility to search 
    the content of his/her resource entries for
    given keywords.
    This feature was implemented using apache
    lucene.
    
[*] Migration of Manager Classes
 	maintenance work on the manager classes to make
 	a general usable interface
 	
[*] Migration of ContentConverter-Manager
    ContentConverter-Manger is now started as system
    component and loads the list of available converstion
    modules from database. Therefore this list can 
    now easliy by inserting a new entry in the proper
    database table. 	
          
[*] Migration to Apache Axis SOAP 1.2 RC2 release
    needed because of XML parser problems ...        
          
TODOS:
--------------------------- 
    
[TODO] TODO: Trash ...       

==================================================
C4U V0.4 	
==================================================

PHP INTERFACE:
--------------
[+] NF/Resource Configuration - Hint Box
    Now the javascript hintbox is used to display
    the description of a configuration parameter
    to allow html formated descriptions ...
    
[#] Resource Entry Configuration Bugfix
    A textfield was displayed instead of a combo
    box for the configuraton of an Boolean value.
    
[+] Resource Folder sorting bug fixed
	Folder names were not sorted correctly based 
	on there name .   
	
[+] Configuration Option Restrictions
    Now it's possible to define restrictions for
    a configuration option. This restrictions are
    than shown using a combo box instead of a 
    normal text field.

HARVESTER MODULES:
--------------------- 
[+] new "Google Search" resource type added
    A new resource type was added which allows to
    do google searches via the Google Webservice
    API.
    Of couse this functionality could also be done
    using the normal soap resource, but it's much
    easier to configure this way ;-)
    
[+] new "email" resource type added
    A new resource type was added wich allows to
    monitor a pop3 mailbox for changes. Currently
    all changes (including new emails / removed 
    emails) are reported, but this behaviour should
    be configureable in later versions using the
    criteria of change settings ...
    
[+] new "ssh / scp" resource type added
    This new resource type allows the monitoring of
    the output of a remotely executed command or
    the monitoring of the content of a remotely 
    via scp accessible file.
    
NOTIFICATION MODULES:
--------------------- 
[+] ICQ - Notification
    New Notification that is used to send ICQ 
    Notifications to the users.    

OTHERS:
--------------------- 
[#] Shutdown bug fixed
    ClassCastException on Server shutdown fixed

[#] Bookmark Import Bugfix
    The wrong resource type id was used on resource
    import. 

==================================================
C4U V0.3.5 	(2004-12-08)
==================================================

PHP INTERFACE:
--------------
[+] Sending of Difference Highlighting per Email
    Now it's possible to send the Diff directly from
    the C4U webinterface to another persion via email.

[+] Difference Highlighting Short Format
    The user can now choose on the Highlighting page
    if a short format (with snipped lines) or the
    original long format should be used. 
    
[+] Bulk Operation 4 Notifications added
    now it's possible to enable/disable/delete
    more than one notification in parallel.   
    
[+] Link Prefetching added
    Html meta tag to prefetch the original content
    of a resource entry added.      
    
[*] GUI restructuring
    the gui structure was completely restructured
    to support additional resource types to check.
    The configuration of a resource now works the
    same way as the configuration of a notification.
    Almost all hardcoded parts were removed from 
    the php source. 
    Thanks to Manfred for his help to restructure
    the old notification configuration sources so 
    that I was able to use the same technique for 
    the resource entry configuration.
    
[*] GUI - login
    login behaviour has changed. If a timeout has
    occured and the user does a login then he/she
    will be redirected to the original site which
    he/she want's to visit (instead of the status
    page which is shown otherwise).        
    
[*] Charset problem
    added accept-charset="UTF-8" to each used 
    web form to avoid charset problems.    
    
[+] Resource Search extended
    additional query options:    
    - search in link
    - search for enabled/disabled resources
    - search for resources with status ok/error
    - search for modified/unchanged resources
    - search for resources newer than x days ...    
    
[+] Resource Archiv Copy - Frameset
    Archiv Copy functions modified to support the
    display of archiv copies containing framesets.
    To support this, the links contained in the
    frameset definition will be rewriten eacht
    time the archiv copy should be displayed ...
    
[+] Get title / entry configuration
    Now it's possible to get the resource entry title
    from the resource content during the configuration
    of the resource entry.
    
[#] quickAddLink Bug 
    an java.io.UTFDataFormatException occures
    if the website title contains special ISO-8859-1 
    chars. 
    Now the title is converted properly to UTF8
    to avoid problems.
    
[#] edit entry / empty title bug
    title was not displayed correctly when editing
    the settings or an existing resource entry   
    
[#] empty resource / enable query bug
    now it's not possible anymore to enable a resource
    for query that has no resource entries.
    
[#] login / errormessage bug     
    now the proper error message will be displayed if
    login fails because no connection could be 
    established to the C4U server.

[#] Show Resource Content bug
    now the proper mime type is set for the content
    of a soap call / zip file / text file ...

[#] Notification / Resource - Config. Option Sort Bug
    Sorting problem in configuration dialogs fixed
    using TreeMaps instead of HashMaps for internal
    Buffering

[#] Hint box Bug
    If a resource entry name contains quotes than
    no resource hint box was displayed.
    
    
NOTIFICATION MODULES:
---------------------        
[+] Email Notification / Subject
    If the email contains only one notification then
    the personal resource name will be shown in the
    email subject         
    
[+] Email Notification / Links
    Now additional links will be provided within the
    email
    - link to web content
    - link to configure resource
    - link to go into upper folder of resource
    - link to clear notification flag
    - link to disable query of resource
    - link to configure notification
    - link to disable notification    
    
[*] SOAP Notification - Configuration
	unnecessary configuration options removed from
	SOAP notification.
	SOAP NF renamed to SOAP RPC Notification
	
HARVESTER MODULES:
---------------------    

[+] New 'SOAP' resource type added
    now it's also possible to check RPC styled webservices  
    
[+] New 'HTTP Post' resource type added
    now it's possible to check resources that are only 
    accessible via http post.
      
[#] Resource Inspection / Entry not checkable Bug
    two not checkable resource entries have caused 
    the inspection result to be 1.0 which means 
    that the resource was not modified.
    
[+] Frameset support implementation complete
    Now C4U supports the (transparent) monitorinig of 
    framesets. From a logical point of view each frame
    is seen as extra entry. If one of the frames has 
    changed (including the file containing the framset
    definition) then the entry is seen as modified.

==================================================
C4U V0.3.02
==================================================

PHP INTERFACE:
--------------
[+] GUI LAYOUT
    - Colors changed
    - C4U version will now be displayed in the
      top right corner

[+] ARCHIV COPY - HIGHLIGHTING
    Highlighting migrated to support the
    comparison of any two copies.
   
[+] ARCHIV COPY - DELET
    Bulk delete operation on archiv copies
    available now   
    
[+] ADMINISTRATION
    new Admin Page
    - can be used for server shutdown
    - to view the current server properties
    - to view a list of registered users   

[+] DEFAULT NOTIFICATION:
    support of 'default' notifications added.   
    now a NF can be set as default. This means
    that the NF will be assigned to each newly
    created resource 

[+] BULK - ENABLE/DISABLE/DELETE/CLEAR NF-FLAG
    now it's possible to enable/disalbe/delete
    personal resources in bulk, or reset multiple
    notification flags
   
[+] FORCE QUERY: 
    new operation to force the query/inspection
    of a personal resource
   
[+] NEXT QUERY:
    new status page that can be used to
    show which resources will be queried next.
    This dialog also allows it to forct the query
    of some of the resources.
    This dialog has does a automatic refresh to
    periodically reload the list
   
[+] MOVE RESOURCE:   
    now multiple resources can be moved into
    an other folder using a new bulk operation
   
[+] RESOURCE INFO BOX:
    now the resource entry title is displayed instead
    of the resource entry link. Additionally the favicon
    of each entry is shown in the resource info box.   

[+] P.RESOURCE - RESOURCE ENTRY LIST:
    now the favicon of each entry will be displayed in
    the personal resource - resource entry list. If no 
    favicon is availabe a default icon is displayed instead.  

[+] GUI NOTIFICATION
    the dialog 'lastModified' now has a automatic
    refresh and displays a javascript popup
    if a new modification was detected.
    This feature can be seen as some kind of
    GUI Notification
   
[+] QUICKLY ADDING RESOURCES FEATURE
    Introduction of a special link that can be added
    to the browsers toolbar (tested with mozilla, IE
    and Opera). 
    The user can browse to a webpage and can then click
    on the special link to add the current webpage as 
    new personal resource to C4U.
   
[+] SEARCHING OF RESOURCES implemented
    New feature to search for personal resources
    using keywords.
    Currently the search is done using the personal
    resource name and comment.

[#] DIFFERENCE HIGHLIGHTING Bugfix
    the first unmodified block of lines was
    accidentally shown twice in the Difference
    Highlighting output.
    
[#] NEW RESOURCE / MENUE-BAR Bugfix
    The menue items "resource", "notification",
    "criteria of change" and "folder" were
    accidentally shown when creating a new item 
    
[#] Move Resource to Root Bug fixed

NOTIFICATION MODULES:
---------------------
[+] SHORT FORMAT for HIGHLIGHTING:
    the text highlighting module has now an
    additiona option to snipp unneccessary unmodified
    lines from the highlighting output to get a shorter
    format.   
    This feature is currently used for the email 
    notification
      
[+] RSS NOTIFICATION ADDED
    first trial of a passive rss notification which 
    generates a rss feed containing the last detected
    modifications of the users resource.
    for this feature i have added an embedded http web-
    server to the C4U server which can be used in further
    version for other passive notifications.
    Another advantage of this embedded http server is, that
    we are independent from the php gui.
    One requirement on the rss reader is that it supports
    basic http authentication
   
HARVESTER MODULES:   
------------------ 
[+] FAVICON SUPPORT
    now the favicon (if available) of each http resource 
    will be downloaded, converted into png and can be displayed
    on the gui afterwards.

[*] PDF CONVERSION PLUGIN 
    Migration from PDFbox 0.6.6 to PDFBox 0.6.7a   
   

*) Redirection Bug fixed.
   Accidentally disabled follow redirection   
   
==================================================
C4U V0.3.01
==================================================

PHP INTERFACE:
--------------
[+] RESOURCE INFO BOX:
    new resource info box which shows some 
    important infos of a resource if the user
    moves with the mouse pointer over the resource
    icon   

[+] RESOURCE ENTRY TITLE
    For the first resource entry of a 
    personal resource, the personal resource
    title will be taken over as suggestion
    for the title of the new entry. 
    
[+] ARCHIV COPY LIST
    New dialog to display the archiv copy
    list of a resource entry

[+] LAST MODIFICATION LIST
    adding reload functionality for periodically
    reloading of the last modification page. Additionally
    a javascript popup will be shown if a new modification
    was detected. 
    This feature can be seen as gui notification.
    A configuration dialog for the refresh interval is currently
    missing.
    
[#] Personal Resource Status
    Now the correct status text will be
    displayed instead of a general status
    text
    
[#] CHANGE P.RESOURCE TITLE / COMMENT Bugfix
	a nullpointer-exception has occured when trying
	to change the title or comment of a personal
	resource

[#] PERSONAL RESOURCE / FOLDER MENUE ITEM Bugfix.

[#] PERSONAL RESOURCE / NF MENUE 
    when the nf menue item was used and the
    user has tried to use the back button to
    jump back to the upper folder, we accidentally
    jumped back to the root folder.	

[*] some internal structure changes to improve
    maintenance 

NOTIFICATION MODULES:
---------------------
[*] PERSONAL RESOURCE OBJECT
    added new java object for the personal resource. 
    This obj. can then by used by the NF modules to 
    generate a more meaningful NF message.
   
[+] EMAIL NF - HIGHLIGHTING 
    Now it's possible to send the highlighted changes
    as email

C4U SERVER:
---------------------
[*] Performance Optimization
   using HashMaps instead of HashTables to improve performance

[*] Migration to Java 5.0
    using new collection feature now for our internal
    configuration settings structures to make them more
    failsafe.     

[#] Bookmark Export bugfix   
    some parts of the bookmark list were accidentally
    appended twice into the export file.   
   
==================================================
C4U V0.2.00
==================================================
This is the first stable version of C4U. 
   

==================================================
Legend:   
[+] new feature 
[-] removed feature 
[*] internal changes
[!] known Bug 
[#] Bugfix 
[?] open issue
   
   						
 
C4U II - Project report:

Download

New C4U Version 0.5

Many bugfixes
RSS/bzip/tar support
better dynamic content support
Criteria of change support
https support
...

New C4U Version 0.4

New resources added:
  • google search
  • SSH / SCP
  • Email monitoring
New Notification added:
  • ICQ Notification

New C4U Version 0.3.5

Many new features, e.g. http post or html frameset support added.

For details please take a look into the changelog

check4update
jSoapServer
YaCy

SourceForge.net Logo

Check4Update Project - last updated 22/02/2006