Forecast™ version 4.4.0
Facilita™ Forecast™ 4.4.0 contains a host of exciting new features, see below for details!
Notes:
- you must have a valid, up-to-date support and maintenance contract to benefit from new product releases
- to upgrade to the latest version of Forecast™ Studio, all Injector machines must also be upgraded
- (coming in 4.4.1, not in the initial release of 4.4.0) the TCPIP Virtual User has been superseded by the new IP virtual user - if you have any custom Virtual Users or any scripts based on the existing TCPIP Virtual User, please contact the Facilita™ support team before upgrading
Forecast™ Studio 4.4.0 new features:
- Web recording:
- When recording a web script there is a new list of applications that can be launched automatically by the Recorder. This list contains
- Google Chrome
- Microsoft Internet Explorer and
- Mozilla Firefox.
- If any of these applications are not installed on the controller machine then they cannot be selected from the list
- When recording a web trace, a snapshot of the browser window is taken every time a transaction name is entered into the Recorder dialog. A thumbnail strip of snapshots has been added to the Recorder dialog. When the trace is viewed in the Web Trace Viewer application, a new tab 'Snapshot' displays the snapshot that was taken at the time of recording and matches the currently viewed transaction
- Another new feature when recording a web trace is the 'Hosts' tab, which allows the de-selection of hostnames that have been encountered during the recording, and when the web script is generated these hosts will be ignored at runtime. The hostnames are persisted at the project level, so when another recording is taken the hosts that were excluded from the previous recording can also be excluded for the current recording (this is completely configurable from the Hosts tab in the Recorder). Hostnames can be deselected individually and by defining regular expressions
- Another new tab added to the Recorder is the 'Messages' tab, which displays a log of commands and any messages
- The 'Stop' (recording) button has been added to the Web Script Recorder dialog but removed from the underlying dialog, to simplify the user interface
- Transactions can be renamed whilst a script is being recorded
- Web Script generation:
- The protocol(s) for a generated web script have now been parameterised, making it easier to change the protocol(s) in each script
- In generated web scripts we now write setHeaderValue() calls for all non-standard headers encountered in the trace, ensuring they will be automatically set at runtime
- NetBeans integration:
- If NetBeans is installed, it is possible to launch this IDE from within Studio and build the (java) Forecast™ project within NetBeans
- dynaTrace integration (6.9.1, 7.x):
- If dynaTrace is installed, there will be a new tab on the left-hand side of Studio named 'dynaTrace'. Various dynaTrace configuration options have been added to this new tab. The dynaTrace header can be set on a per Virtual User group basis by setting the new option on the 'Web: Logging' tab of the 'Runtime Settings' tab for the Virtual User group
- Test export:
- This new feature within Forecast™ Studio allows tests to be exported as single .zip files that contain everything required to run the test. The .zip file can be extracted onto any target machine and run without having to install any other Facilita™ software.
- The limitation is that only tests that are defined to run with a single virtual user can be exported
- New product icons, splash screen and logo
Forecast™ Communications (Test Controller / Studio / Injectors / Engines) 4.4.0 new features:
- The communications between Test Controller/Injectors/Engines have been redesigned to provide a more robust and reliable service.
- Error message texts have been improved
- All files sent between Test Controller/Injectors/Engines are now zipped for transfer thereby decreasing transfer times
- A new status bar added showing the progress for the retrieval of the log files from the remote injectors
- The default injector and engine port numbers have changed to ensure that we do not use ports in the dynamically allocated range (of ephemeral ports), this will resolve port conflicts with other running applications and provide smoother test executions. This change complies with (and for further information, see) this article
- New registry settings added to optimize the usage of TCP ports for all versions of windows. For a controller machine, run 'Optimize System Settings ...' from the Tools menu in Test Controller. Reboot the injector machine as appropriate to ensure the registry settings are applied.
- For injector machines, click on 'forecastOptimalSettings_x86.reg' or 'forecastOptimalSettings_x64.reg' from within the installation folder. Reboot the injector machine as appropriate to ensure the registry settings are applied.
- When running a large number of engines on an injector, if there are any problems starting all of the engines, increase the Injector 'Connect-back timeout for engines' value to ensure that all engines start correctly
Forecast™ Test Controller 4.4.0 new features:
- We have added new 'Aborted' and 'Unknown' states to Test Controller which more clearly define the known statuses of the running virtual users
- The 'Last Alert' is now displayed at the top of the main window and is updated in real time
Forecast™ Analyzer 4.4.0 new features:
- Analyzer will now warn (during database creation) if not all of the expected virtual user log files are available for a test run
Miscellaneous improvements:
- Many other issues resolved and many small additional features added
Facilita Forecast™ Studio v4.3.0 - New Features
Latest Build - 699 |
Studio
- The Studio graphical user interface has undergone a technology refresh and looks cleaner and crisper than before.
- When loading a workspace that was created with a previous verson of Studio, an upgrader will automatically run and provides an automated backup function.
- The log file name has changed to include the date and time and the content has been revamped to include time stamps and severity level.
- The 'Handle Dynamic URLs' web-script generation option has been removed.
- Workspaces and projects are now built together, F8 performs a build, ALT+F8 performs a full rebuild. The options to build the project and workspace separately have been removed, whereas the ability to open each separately in an IDE has been maintained.
- Much improved dynamic build output messaging windows, which can be maximised or hidden from view until needed (press SHIFT+ESCAPE or through context menu).
- Whenever there is a compile-time error, clicking on an entry in these windows will open the script at the failing line in the Scite text editor.
- New (clickable) build indicators added.
- New build progress bar added.
|
Web
- The Internet Explorer Recorder has been removed, as has the old Proxy Recorder. These have been replaced by the new Fiddler Core Proxy Recorder, which provides an option to delete the Internet Explorer cache and files before recording starts.
- New HTTP 'PUT' and 'DELETE' support.
- Added support for the WinHTTP socket handler. This handles NTLM authenication better than WinInet. WinHTTP should be used in preference to WinInet for HTTP and HTTPS.
- The setOptions() method call in web scripts has been replaced with a new pre() method.
|
Other protocols
- Custom Virtual Users now have pre() methods (all protocols).
- New TCP recorder and generator. New scriptable UDP support (generator to be released soon).
|
Test Controller
- Now reloads changes to the workspace or tests automatically.
|
Miscellaneous
- Many further minor improvements and enhancements (>200).
|
Facilita Forecast™ Analyzer v4.3.0 - New Features
Latest Build - 671 |
| When creating a view for an analysed database, either clock time or elapsed time can be chosen, and this will be displayed for each of the created charts |
| Additional data files (metrics for the System Under Test or Injector machines which were gathered by Test Controller) are automatically added when creating an analysis database |
Charts are now categorized and displayed in an expandable tree view. Categories include
- 'User Defined': created from metrics gathered in scripts
- 'External Metrics': any metrics gathered by Test Controller for the System Under Test and Injectors
- 'Custom Charts': charts created by the user
- 'HTTP charts': status codes, cache hits/misses, etc.,
- 'Standard charts': transaction information, concurrencies, rates, spread, etc.,
- 'TCPIP charts': how many bytes sent/received, how many connections made, etc.,
- 'Error charts': errors from the test run; Error rate, Errors in transactions
- 'Other charts': pre-existing charts that were created from pre-existing databases will be displayed here. If the database is re-created, the charts will appear in the above categories and this category will not be displayed.
|
| Charts can now be overlaid one over another; two y-axes will be displayed and the chart data tables labelled clearly |
| New Report Designer allows the user to specify which charts should be included in a report, and their order to appear in the report |
| Reports can now be saved to a user-specified location |
Reports can now be created as either HTML format or as a Microsoft Word document (Microsoft Word must be installed on the same machine as Analyzer)
|
release history...
Facilita Forecast™ v4.2.3
| New Features |
| Analyzer is now installed separately from Studio. This version removes the pre-installed version of Analyzer |
| Support for Visual Studio 2010 (full and express editions): all operating systems above (and including) Windows XP/2003 now fully support the building of workspaces and projects within Visual Studio 2010 (C++ and C#) |
| WinHTTP support added for web runtime |
| Network recorder fixes and improvements |
| Numerous bug clearances |
Facilita Forecast™ v4.2.2
| New Features |
| setAllowOverlappingTransactions and getAllowOverlappingTransactions have been removed from the VirtualUser and VirtualUserScript classes. These methods are no longer valid as the transaction handling logic has changed and we no longer need to make this distinction. |
| WinDriver support added for Windows Presentation Foundation (WPF). |
| Enhancements to Cookie handling in web script generator. Will now accurately track client generated and persistent (pre-existing cached) cookies. |
| New VirtualUserScript methods to retrieve the elapsed time since a timing or transaction was started. |
| Extension of the web ‘Content check’ rule type for script code insertion prior to and following a navigation call where an expression is matched inside the returned page. |
| Numerous bug clearances (~100 issues cleared). |
Facilita Forecast™ v4.2.1
| New Features |
| Injectors are now self-maintaining. Once an injector has been installed on a machine, it should not require updating. When a test connects to an Injector, all appropriate libraries, data files and engines will be transferred, meaning that when changes are made to the engine code in the main product it is just the controller machine which will require updating, and the new engines will automatically be transferred to the injector machines. |
| Numerous minor improvements and enhancements. |
Build v4.2.1.50, 21/09/2010
| id | category | summary |
| 4236 |
Analyzer |
Final Page of Create View Wizard removed |
| 4235 |
Analyzer |
Charts re-labelled to indicate if the timing transaction breakdown excludes transactions in error |
| 4221 |
Analyzer |
Failed Transactions are now being treated as transactions in error when overlapping transactions support is selected |
Build v4.2.1.47, 06/09/2010
| id | category | summary |
| 4139 |
Analyzer |
Corrections to the calculation and display of transaction/timing concurrency. We recommend that all raw data is re-processed (recreate the results database) to see the concurrency data for a pre-existing set of results |
Facilita Forecast™ v4.2.0
| New Features |
| Transactions tab has been removed from web script generation options. The generator now auto-detects whether transactions exist. |
| User defined metrics are collected at runtime, and have corresponding charts in Analyzer and Test Controller ('Average', 'Sum' and 'Rate'). |
| Web metrics are collected at runtime, and are written to the VU logs - from this additional data new charts have been created, and added to both Analyzer and Test Controller. |
| Using higher resolution multimedia timer, instead of standard win32 timers, to improve the accuracy of timings. |
| New 'filter' feature implemented for the event logs in Analyzer and Test Controller. |
| Product now built against .NET 3.5. |
| Web runtime: more efficient data compression support & direct access to this functionality from scripts. |
| TCP/IP network traffic Virtual User support. |
| Runtime supports "Allow overlapping transactions" functionality. |
| Numerous minor improvements and enhancements. |
Build v4.2.0.293, 27/07/2010
| id | category | summary |
| 4147 |
Web Runtime |
Ensure postdata is not re-sent as a result of a redirected POST request |
| 4145 |
Web Runtime |
Ensure responses to a POST request are not cached |
| 4140 |
Engine CLR |
Fixed an issue with elapsed times on remote injectors when using C# |
Facilita Forecast™ v4.1.1
Build v4.1.1.82, 22/03/2010
| id | category | summary |
| 3892 |
Analzyer |
Corrections to analysis of suspended/resumed nested transaction times |
Build v4.1.1.81, 09/03/2010
| id | category | summary |
| 3891 |
WinDriver Runtime |
New WinDriver ShowWindow() method that replicates the Win32 ShowWindow API |
| 3849 |
Recorder Web Proxy |
Ensure internet proxy settings are restored after recording for users with limited registry editing permissions |
| 3833 |
Web Runtime |
Corrections to multipart fields for dynamic forms |
Build v4.1.1.80, 09/03/2010
| id | category | summary |
| 3799 |
Gen TCP/IP |
TCP/IP generator & runtime incorporated into product |
Build v4.1.1.78, 23/02/2010
| id | category | summary |
| 3812 |
Recorder Web Proxy |
Handle proxy exceptions as defined in Windows Internet settings |
| 2983 |
Web Trace Viewer |
Web Trace Viewer now contains transaction names in the treeview |
Build v4.1.1.73, 25/01/2010
| id | category | summary |
| 3793 |
Web Runtime |
Tolerate addional white space around HTTP server header names and values |
Build v4.1.1.62, 29/12/2009
| id | category | summary |
| 3740 |
Analyzer |
A selection of VU Group Runtime Settings have been added to the analysis database and report generator |
| 3746 |
Analyzer |
All displayed times now updated to display in 24 hour mode. am/pm suffix removed |
| 3765 |
Runmonitor |
Implemented option for single instance per project |
Build v4.1.1.59, 21/12/2009
| id | category | summary |
| 3749 |
Studio |
When adding/removing custom VU assemblies some information was being corrupted |
Build v4.1.1.58, 18/12/2009
| id | category | summary |
| 3728 |
Build Process |
A new .zip file allows for easier and faster installation of injectors (C++ and Web) without the need to install the full Forecast™ product on the injector machine |
Build v4.1.1.56, 16/12/2009
| id | category | summary |
| 3727 |
Build Process |
A new .msi file allows for easier and faster installation of injectors (all protocols) without the need to install the full Forecast™ product on the injector machine |
Build v4.1.1.43, 04/12/2009
| id | category | summary |
| 3705 |
Runmonitor |
Prevent error on opening hlogviewer when there are a very large number of files and folders, and improved performance of opening the hlogviewer |
Build v4.1.1.41, 03/12/2009
| id | category | summary |
| 3697 |
Engine CPP |
C++ engine will catch non-C++ exceptions in scripts and continue rather than terminating |
Build v4.1.1.40, 02/12/2009
| id | category | summary |
| 3689 |
Test Controller |
New checkbox allows prevention of autoscrolling for the dialog which displays the status information for test ramp-up |
Build v4.1.1.34, 01/12/2009
| id | category | summary |
| 3686 |
Test Controller |
If an injector fails to start, the full engine count of that failed injector is considered and may prevent the test from starting |
Build v4.1.1.32, 27/11/2009
| id | category | summary |
| 3682 |
Various |
Changes to the licensing mechanisms, the VU licenses and the license checking functionality |
| 3677 |
Test Controller |
If the option 'transfer data files' is switched off for an injector in Studio, this is now reported when the test is started by Test Controller |
Build v4.1.1.27, 26/11/2009
| id | category | summary |
| 3672 |
Gen HTTP |
Create a Web Service script from an XML file via the record/generate script wizard. If you have access to sample XML file posted as a Web Service request available then simply point at the XML file to create a Web Virtual User script |
Build v4.1.1.26, 26/11/2009
| id | category | summary |
| 3670 |
Web Trace Viewer |
Fixes to Web trace and log viewer to prevent problems when performing a Find in Sent Request data |
| 3667 |
Test Controller |
Added dialogs to Test Controller which inform the user if the runtime settings of the injectors would create an invalid test environment |
Build v4.1.1.23, 25/11/2009
| id | category | summary |
| 3665 |
Engine (All) |
Virtual Users now recorded as "in error" if maximum iteration failures exceeded |
| 3246 |
Analyzer |
Analyzer's VU Concurrency Chart now displays failed Virtual Users |
Build v4.1.1.21, 23/11/2009
| id | category | summary |
| 3664 |
Test Controller |
Engines correctly started on remote injectors if Forecast™ is installed to a different directory than on the controller |
Build v4.1.1.20, 20/11/2009
| id | category | summary |
| 3663 |
Recorder Web Network |
Can now handle URL paths that did not map to a legal file path for the copy of the resource returned by server |
Build v4.1.1.17, 17/11/2009
| id | category | summary |
| 3654 |
Studio |
If the hardware fingerprint of the machine changes substantially and no longer matches the installed VU license keys, all VU license keys will be invalidated and must be regenerated by Facilita |
| 3653 |
Studio |
Invalid or expired VU licenses will be highlighted in the Licenses dialog (displayed via Help->Licenses) |
Build v4.1.1.16, 16/11/2009
| id | category | summary |
| 3648 |
Studio |
Save button now enabled if a workspace does not contain a project, allowing workspace changes to be modified and saved |
Build v4.1.1.13, 12/11/2009
| id | category | summary |
| 3625 |
Recorder Web Proxy |
When using the proxy recorder the web browser will no longer issue warnings about invalid certificates when recording HTTPS providing the Facilita certification authority certificate has been installed as a trusted root certificate |
Build v4.1.1.10, 11/11/2009
| id | category | summary |
| 3403 |
Studio |
Improved the speed of loading the right hand list view pane when selecting a folder in the tree view |
| 3565 |
Studio |
Tool-tips added to all controls on the Advanced tab for Injectors |
| 3640 |
Web Runtime |
Addressed a memory leak in extractRegExp method |
Build v4.1.1.9, 10/11/2009
| id | category | summary |
| 2905 |
Studio |
Ensure all VU web-specific runtime properties changes apply only to the specified group |
| 3393 |
Engine CPP |
Comments added to custom VU templates to encourage use of pre() and post() methods |
Build v4.1.1.2, 09/11/2009
| id | category | summary |
| 3613 |
Studio |
Case-sensitive match no longer permits creation of scripts with same names within a project |
| 3230 |
Studio |
Clicking on a compiler error (C++ 2008) within Studio (build tab) will invoke an editor and position the cursor at the offending line in the code |
| 3613 |
Studio |
Case-sensitive match no longer permits creation of scripts with same names within a project |
Build v4.1.1.1, 06/11/2009
| id | category | summary |
| 3305 |
Analyzer |
Progress point messages now correctly exported as part of the export events option in Analyzer |
Facilita Forecast™ v4.1.0
Build v4.1.0.201, 27/10/2009
| New Features |
| Licensing has changed. There is no longer a need for a 'runtime.lic' file. A machine license is granted (and input via a dialog upon installation of Forecast™), together with any number of separate Virtual User licenses (which are added/removed via the Forecast™ menu option 'Help->Licenses'). |
| Web generation rules are now defined using the GUI. Rules can be applied at both the Virtual User and Script level. See the User Guide for more details. |
| Application logs are now automatically flushed. It is no longer necessary to close Studio or Test Controller in order to flush the logs. |
| An Analyzer SDK (.NET) that enables programmatic creation of Analyzer databases and views. Note that charting functionality is not yet available from the SDK. |
| Framework mode has been removed. Custom VUs are now accessed through the Workspace and built via the Build menu option. |
| New Python APIs allow tests to be run from the console or from user created Python scripts. |
| Import and export data with the Shared Data Server in .csv format. |
| Studio will no longer start/stop the local injector processes, Test Controller will start any required local injector processes and terminate them when they are no longer required. The local injector is no longer installed as a service. |
| Linux injector for Java is available on request. |
| Workspaces can now only be opened by one user at a time. |
| Many improvements to the handling of multiple injectors/engines. |
| Numerous minor improvements and enhancements. |
Facilita Forecast™ v4.0.2
Build v4.0.2.126, 10/11/2009
| id | category | summary |
| 3639 |
Web Runtime |
Fixed memory leak in extractRegExp method |
Build v4.0.2.125, 30/09/2009
| id | category | summary |
| 3529 |
Build Process |
Visual Studio 2005 SP1 applied to the build environment |
Build v4.0.2.124, 25/09/2009
| id | category | summary |
| 3433 |
Recorder Web Proxy |
Resource names (images) corrected where a web trace is recorded via the proxy recorder |
Build v4.0.2.121, 18/08/2009
| id | category | summary |
| 3414 |
Analyzer |
"Add Files" button now visible on Additional Datasets dialog |
| 3420 |
Version 3 Project Upgrader |
Group-level inline data dictionaries are included when a project is upgraded from V3 to V4 |
| 3444 |
Web Runtime |
Content Type: application/json correctly recorded to the hlog |
| 3455 |
Web Runtime |
Prevent potential engine crash during error reporting |
| 3459 |
Web Runtime |
Corrected a minor issue with potential malformed URLs when experiencing a very high rate of concurrent HTTP requests |
| 3461 |
Shared Data Server |
Removed some unnecessary log files |
| 3472 |
Web Runtime |
Updated openSSL from 0.9.7e. to 0.9.8.k |
Build v4.0.2.120, 18/08/2009
| id | category | summary |
| 3412 |
Web Runtime |
If RequestData contains an empty key/value pair, this will now appear as '=' (previously an empty string) |
Build v4.0.2.119, 17/08/2009
| id | category | summary |
| 3110 |
Web Trace Viewer |
Corrected disparity in the display of hexadecimal characters between the web trace viewer and the original recorded trace |
| 3380 |
Web Trace Viewer |
Character encoding is automatically selected based on the value present in the Content-type header (defaults to utf-8) |
| 3408 |
Engine (All) |
The DataTable function '.reset()' will now position the table at the first element, instead of before the first element |
Build v4.0.2.118, 06/08/2009
| id | category | summary |
| 3364 |
Web Runtime |
Empty NTLM passwords now set WinInet InternetConnect() password parameter to '0', instead of a pointer an empty string. |
| 3372 |
Studio |
Corrected minor problem importing some custom Virtual Users |
Build v4.0.2.116, 31/07/2009
| id | category | summary |
| 3334 |
Compilers and builders |
Added project file 'fcodbc_vc9.vcproj' to installer |
| 3353 |
Web Runtime |
Prevented requests from being sent on closed TCP connections |
Build v4.0.2.115, 28/07/2009
| id | category | summary |
| 3331 |
Compilers and builders |
When a project contains Java scripts only build the appropriate platform libraries (linux / win32) - was building both |
Build v4.0.2.114, 23/07/2009
| id | category | summary |
| 3323 |
Web Runtime |
All page resources now downloaded for all redirected pages |
| 3324 |
Studio |
When creating a new injector user must now supply platform details (linux / win32) - previously assumed win32 |