X-Git-Url: http://demsky.eecs.uci.edu/git/?a=blobdiff_plain;f=utils%2FNightlyTestTemplate.html;h=9f96b44a72e58c698aa283d042113df3bbb22c03;hb=cd7c2877307bc82fdda978dc6f97d4c608e77a80;hp=bf6894b88c6e1cf85ff0977c70bf91f12c922211;hpb=4050f7f6f269faf218678f6b0aa88931aa7da816;p=oota-llvm.git

diff --git a/utils/NightlyTestTemplate.html b/utils/NightlyTestTemplate.html
index bf6894b88c6..9f96b44a72e 100644
--- a/utils/NightlyTestTemplate.html
+++ b/utils/NightlyTestTemplate.html
@@ -41,17 +41,28 @@
 <font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
 </td></tr></table></td></tr></table></center><p>
 
+<!-- Running LOC graph -->
+<table align=right>
+<tr><td>
+<a href="running_loc_large.png"
+   ><img border=0 width=480 height=360 src="running_loc.png"></a>
+</td></tr>
+<tr><td align=center>Lines Of Code over Time<br>
+<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
+</td></tr>
+</table>
+
 <h2>CVS Tree Overview:</h2>
 <ul>
 <li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
 <ul>
-    Time to check out CVS tree:  <b>$CVSCheckoutTime</b> seconds<br>
-    Number of directories in CVS: <b>$NumDirsInCVS</b><br>
-    Number of files in CVS: <b>$NumFilesInCVS</b><br>
-    Number of lines of code: <b>$LOC</b></ul>
+    <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
+    lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
 <li><a href="$DATE-Build-Log.txt">Compilation Log</a>
 <ul>
     $BuildError
+    Time to configure CVS tree:      <b>$ConfigTime</b> seconds
+               (<b>$ConfigWallTime</b> seconds wall time)<br>
     Time to build CVS tree:      <b>$BuildTime</b> seconds
                (<b>$BuildWallTime</b> seconds wall time)<br>
     Number of object files compiled: <b>$NumObjects</b><br>
@@ -99,15 +110,56 @@
 <font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
 </td></tr></table></td></tr></table></center><p>
 
-GNUplot <b>charts</b> showing a couple of things:
-<ol>
-<li>LOC in CVS
-<li>Compile Time
-<li>Testing Time
-<li>Time to run some programs, say all of Olden
-<li>Time to compile something, say Olden.
-<li>Size of bytecode files for Olden
-</ol>
+
+Here are some charts showing how the LLVM optimizer and code generators are
+changing over time.  For now we use the Olden benchmark suite to measure this,
+but eventually we will switch to using SPEC CPU2000.  All programs are run with
+"LARGE_PROBLEM_SIZE" enabled.  Click on any of the charts to get a larger
+version.<p>
+
+<h2>Compilation Measurements:</h2>
+
+<table border="0" align=center>
+<tr>
+<td width=50% align=center>
+<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
+Size of LLVM bytecode files
+</td>
+<td width=50% align=center>
+<a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br>
+Size of native machine code for each program (generated by the JIT)
+</td></tr>
+<tr>
+<td align=center>
+<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
+Time to run the LLVM optimizer on each program
+</td>
+<td></td></tr>
+</table>
+
+<h2>Program Execution Measurements:</h2>
+
+<table border="0" align=center>
+<tr>
+<td width=50% align=center>
+<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
+Execution time for CBE generated executable
+</td>
+<td width=50% align=center>
+<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
+Execution time for the LLC generated executable
+</td></tr>
+
+<tr>
+<td align=center>
+<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
+Execution time for program in the JIT
+</td>
+<td></td></tr>
+</table>
+
+
+
 
 <br><br><center>
 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
@@ -116,42 +168,66 @@ GNUplot <b>charts</b> showing a couple of things:
 </td></tr></table></td></tr></table></center><p>
 
 This section tests LLVM on a variety of programs in the test suite.  This
-includes benchmark suites like the Olden, ptrdist, and SPEC benchmarks as well
-as a few random programs with test inputs.  This section is meant to track how
-stable LLVM is as a whole.  The columns of the tables are:<p>
+includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
+well as a few random programs with test inputs.  This section is meant to track
+how stable LLVM is as a whole. A failure in the execution of any test is marked
+with an asterisk: `*'. The columns of the tables are:<p>
 
 <ol>
-<li><a name="Program">Program - The name of the program for that row
-<li><a name="GCCAS">GCCAS - Time to run LLVM optimizers on the program
-<li><a name="Bytecode">Bytecode - The size of the bytecode for the program
-<li><a name="Instrs">Instrs - The number of LLVM instructions in the
-    compiled bytecode
-<li><a name="LLC">LLC - The time taken compile with LLC (the static backend)
-<li><a name="NAT">NAT - The time taken to execute the program when compiled
-    with GCC -O3.
-<li><a name="CBE">CBE - The time taken to execute the program after compilation
-    through the C Backend.  If the diff fails, this a *.
-<li><a name="LLC">LLC - The time taken to run LLC compiled program
-<li><a name="JIT">JIT - How long does the program take to execute in the
-    Just-In-Time compiler.
-<li><a name="MachCode">MachCode - The number of bytes of machine code
-    generated by the JIT.
-<li><a name="CompTime">CompTime - The amount of time spent in the JIT itself,
-    instead of executing the program.
+<li><a name="Program">Program</a> - The name of the program for that row.</li>
+<li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
+<li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
+    program</li>
+<li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
+    compiled bytecode</li>
+<li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
+    LLC (the static backend)</li>
+<li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
+    JIT itself, instead of executing the program.</li>
+<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
+    code generated by the JIT.</li>
+<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
+    with GCC -O2.</li>
+<li><a name="CBE">CBE</a> - The time taken to execute the program after
+    compilation through the C backend, compiled with -O2.</li>
+<li><a name="LLC">LLC</a> - How long does the program generated by the static
+    backend LLC take to execute </li>
+<li><a name="JIT">JIT</a> - The amount of time spent running the
+    program with the JIT; this includes the code generation phase (listed above)
+    and actually running the program.</li>
+<li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native 
+    GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
+<li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native 
+    GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
 </ol><p>
 
-A complete log of testing <a href="$DATE-ProgramTest.txt.gz">is available</a>
-for further analysis.
+A complete log of testing 
+<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>, 
+<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
+<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
+available</a> for further analysis.
+
+<h2>Programs/External</h2>
+
+<center>
+<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
+$ExternalProgramsTable
+</td></tr></table></center>
 
 <h2>Programs/MultiSource</h2>
 
 <center>
 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
-$ProgramsTable
+$MultiSourceProgramsTable
 </td></tr></table></center>
 
 <h2>Programs/SingleSource</h2>
 
+<center>
+<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
+$SingleSourceProgramsTable
+</td></tr></table></center>
+
 
 
 <br><br><center>