X-Git-Url: http://demsky.eecs.uci.edu/git/?a=blobdiff_plain;f=utils%2FNightlyTestTemplate.html;h=c38bb2e776bbe4e7aadfa462cd8d06863c319c0b;hb=ef4fd3572627f59b8787107632605835993f9a1c;hp=299bd803f419465498b29daa9dcadb51e9d103c5;hpb=0137afab0ae1c51da6a96d549529cba0e87d67f3;p=oota-llvm.git
diff --git a/utils/NightlyTestTemplate.html b/utils/NightlyTestTemplate.html
index 299bd803f41..c38bb2e776b 100644
--- a/utils/NightlyTestTemplate.html
+++ b/utils/NightlyTestTemplate.html
@@ -1,4 +1,3 @@
-
LLVM Test Results for $DateString
@@ -15,9 +14,9 @@
Overview
Changes
+Dejagnu Tests
Trends
Programs
-Regression
|
@@ -30,8 +29,8 @@
Back to:
-Test Results
-LLVM Page
+Test Results
+LLVM Page
@@ -41,28 +40,44 @@
Today's Test Results Overview
|
+
+
+
+Nightly Test Overview:
+
+ - Start: $TestStartTime
+ - Finish: $TestFinishTime
+ - Platform: $TestPlatform
+
CVS Tree Overview:
- CVS Checkout Log
- Time to check out CVS tree: $CVSCheckoutTime seconds
- Number of directories in CVS: $NumDirsInCVS
- Number of files in CVS: $NumFilesInCVS
- Number of lines of code: $LOC
+ $NumDirsInCVS dirs, $NumFilesInCVS files, $LOC
+ lines of code, checked out in $CVSCheckoutTime seconds
Compilation Log
-
- $BuildError
- Time to build CVS tree: $BuildTime seconds
- ($BuildWallTime seconds wall time)
- Number of object files compiled: $NumObjects
- Number of libraries linked: $NumLibraries
- Number of executables linked: $NumExecutables
-
+
+Item | CPU Time | Wall Clock |
+Configure CVS Tree | $ConfigTime | $ConfigWallTime |
+Build CVS Tree | $BuildTime | $BuildWallTime |
+Run Dejagnu Tests | $DejagnuTime | $DejagnuWallTime |
+
+Number of object files compiled: $NumObjects
+Number of libraries linked: $NumLibraries
+Number of executables linked: $NumExecutables
+Build Status: $BuildStatus
Warnings during the build:
-
+$WarningsList
@@ -80,10 +95,10 @@
Changes to Warnings:
-
-- Warnings Added: $WarningsAdded
-
- Warnings Removed: $WarningsRemoved
-
+ Warnings Added:
+$WarningsAdded
+Warnings Removed:
+$WarningsRemoved
Changes in the test suite:
@@ -92,22 +107,68 @@
- Newly passing tests: $TestsFixed
- Newly failing tests: $TestsBroken
+ |
+
+
+
+
+
+$DejagnuTestResults
+A complete log of testing Feature and Regression is available for further analysis.
-GNUplot charts showing a couple of things:
-
-- LOC in CVS
-
- Compile Time
-
- Testing Time
-
- Time to run some programs, say all of Olden
-
- Time to compile something, say Olden.
-
- Size of bytecode files for Olden
-
+
+Here are some charts showing how the LLVM optimizer and code generators are
+changing over time. For now we use the Olden benchmark suite to measure this,
+but eventually we will switch to using SPEC CPU2000. All programs are run with
+"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
+version.
+
+
Compilation Measurements:
+
+
+
+
+![](running_Olden_bytecode.png)
+Size of LLVM bytecode files
+ |
+
+![](running_Olden_opt_time.png)
+Time to run the LLVM optimizer on each program
+ |
+
+
+Program Execution Measurements:
+
+
+
+
+![](running_Olden_cbe_time.png)
+Execution time for CBE generated executable
+ |
+
+![](running_Olden_llc_time.png)
+Execution time for the LLC generated executable
+ |
+
+
+
+![](running_Olden_jit_time.png)
+Execution time for program in the JIT
+ |
+ |
+
+
+
+
@@ -135,38 +196,49 @@ with an asterisk: `*'. The columns of the tables are:
Machine code - The number of bytes of machine
code generated by the JIT.
GCC - The time taken to execute the program when compiled
- with GCC -O3.
+ with GCC -O2.
CBE - The time taken to execute the program after
- compilation through the C Backend.
+ compilation through the C backend, compiled with -O2.
LLC - How long does the program generated by the static
backend LLC take to execute
JIT - The amount of time spent running the
program with the JIT; this includes the code generation phase (listed above)
and actually running the program.
+GCC/LLC - The speed-up of the LLC output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+GCC/CBE - The speed-up of the CBE output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
+LLC-BETA - How long does the program generated by the static
+ backend LLC take to execute the program, when compiled with new experimental
+ features. This is temporary, for tuning.
-A complete log of testing is available
-for further analysis.
+A complete log of testing
+SingleSource,
+MultiSource, and
+External programs are
+available for further analysis.
- Programs/MultiSource
+Programs/External
-$ProgramsTable
+$ExternalProgramsTable
|
-Programs/SingleSource
+Programs/MultiSource
+
+
+$MultiSourceProgramsTable
+ |
+Programs/SingleSource
-
+
-
-Not yet implemented
+$SingleSourceProgramsTable
+ |
-
+
-