X-Git-Url: http://demsky.eecs.uci.edu/git/?a=blobdiff_plain;f=utils%2FNightlyTestTemplate.html;h=b495de7145bf8a64bde722c7e107c9f2ea8c633b;hb=8eab3608de260527929d327a5e63b547c0d267cf;hp=14af2b74d9cefdb33931ba94f6f5062fe085b6ee;hpb=24eefd3f91f57e4fa71438bba789aeffa2116bf5;p=oota-llvm.git
diff --git a/utils/NightlyTestTemplate.html b/utils/NightlyTestTemplate.html
index 14af2b74d9c..b495de7145b 100644
--- a/utils/NightlyTestTemplate.html
+++ b/utils/NightlyTestTemplate.html
@@ -1,4 +1,3 @@
-
LLVM Test Results for $DateString
@@ -15,9 +14,9 @@
Overview
Changes
+Dejagnu Tests
Trends
Programs
-Regression
|
@@ -30,8 +29,8 @@
Back to:
-Test Results
-LLVM Page
+Test Results
+LLVM Page
@@ -45,32 +44,36 @@
+Nightly Test Overview:
+
+ - Start: $TestStartTime
+ - Finish: $TestFinishTime
+ - Platform: $TestPlatform
+
CVS Tree Overview:
- CVS Checkout Log
- Time to check out CVS tree: $CVSCheckoutTime seconds
- Number of directories in CVS: $NumDirsInCVS
- Number of files in CVS: $NumFilesInCVS
- Number of lines of code: $LOC
+ $NumDirsInCVS dirs, $NumFilesInCVS files, $LOC
+ lines of code, checked out in $CVSCheckoutTime seconds
Compilation Log
-
- $BuildError
- Time to configure CVS tree: $ConfigTime seconds
- ($ConfigWallTime seconds wall time)
- Time to build CVS tree: $BuildTime seconds
- ($BuildWallTime seconds wall time)
- Number of object files compiled: $NumObjects
- Number of libraries linked: $NumLibraries
- Number of executables linked: $NumExecutables
-
+
+Item | CPU Time | Wall Clock |
+Configure CVS Tree | $ConfigTime | $ConfigWallTime |
+Build CVS Tree | $BuildTime | $BuildWallTime |
+Run Dejagnu Tests | $DejagnuTime | $DejagnuWallTime |
+
+Number of object files compiled: $NumObjects
+Number of libraries linked: $NumLibraries
+Number of executables linked: $NumExecutables
+Build Status: $BuildStatus
Warnings during the build:
@@ -105,22 +108,68 @@
Newly passing tests: $TestsFixed
Newly failing tests: $TestsBroken
+ |
+
+
+
+
+
+$DejagnuTestResults
+A complete log of testing Feature and Regression is available for further analysis.
-GNUplot charts showing a couple of things:
-
-- LOC in CVS
-
- Compile Time
-
- Testing Time
-
- Time to run some programs, say all of Olden
-
- Time to compile something, say Olden.
-
- Size of bytecode files for Olden
-
+
+Here are some charts showing how the LLVM optimizer and code generators are
+changing over time. For now we use the Olden benchmark suite to measure this,
+but eventually we will switch to using SPEC CPU2000. All programs are run with
+"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
+version.
+
+
Compilation Measurements:
+
+
+
+
+
+Size of LLVM bytecode files
+ |
+
+
+Time to run the LLVM optimizer on each program
+ |
+
+
+Program Execution Measurements:
+
+
+
+
+
+Execution time for CBE generated executable
+ |
+
+
+Execution time for the LLC generated executable
+ |
+
+
+
+
+Execution time for program in the JIT
+ |
+ |
+
+
+
+
@@ -156,12 +205,27 @@ with an asterisk: `*'. The columns of the tables are:
JIT - The amount of time spent running the
program with the JIT; this includes the code generation phase (listed above)
and actually running the program.
-GCC/LLC - The speed-up of the LLC output vs the native
- GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+GCC/LLC - The speed-up of the LLC output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+GCC/CBE - The speed-up of the CBE output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+LLC-BETA - How long does the program generated by the static
+ backend LLC take to execute the program, when compiled with new experimental
+ features. This is temporary, for tuning.
-A complete log of testing is available
-for further analysis.
+A complete log of testing
+SingleSource,
+MultiSource, and
+External programs are
+available for further analysis.
+
+ Programs/External
+
+
+
+$ExternalProgramsTable
+ |
Programs/MultiSource
@@ -177,16 +241,5 @@ $MultiSourceProgramsTable
$SingleSourceProgramsTable
|
+
-
-
-
-
-Not yet implemented
-
-
-
-