-
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html><head><title>LLVM Test Results for $DateString</title></head>
<a href="#Changes">Changes</a><br>
<a href="#Trends">Trends</a><br>
<a href="#Programs">Programs</a><br>
+<a href="#Feature">Feature</a><br>
<a href="#Regression">Regression</a><br>
</td></tr></table></td></tr></table>
<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
</td></tr></table></td></tr></table></center><p>
+<!-- Running LOC graph -->
+<table align=right>
+<tr><td>
+<a href="running_loc_large.png"
+ ><img border=0 width=480 height=360 src="running_loc.png"></a>
+</td></tr>
+<tr><td align=center>Lines Of Code over Time<br>
+<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
+</td></tr>
+</table>
+
+<h2>Nightly Test Overview:</h2>
+<ul>
+ <li>Start: <b>$TestStartTime GMT</b></li>
+ <li>Finish: <b>$TestFinishTime GMT</b></li>
+ <li>Platform: <b>$TestPlatform</b></li>
+</ul>
<h2>CVS Tree Overview:</h2>
<ul>
<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
<ul>
- Time to check out CVS tree: <b>$CVSCheckoutTime</b> seconds<br>
- Number of directories in CVS: <b>$NumDirsInCVS</b><br>
- Number of files in CVS: <b>$NumFilesInCVS</b><br>
- Number of lines of code: <b>$LOC</b></ul>
+ <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
+ lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
-<ul>
- $BuildError
- Time to build CVS tree: <b>$BuildTime</b> seconds
- (<b>$BuildWallTime</b> seconds wall time)<br>
- Number of object files compiled: <b>$NumObjects</b><br>
- Number of libraries linked: <b>$NumLibraries</b><br>
- Number of executables linked:<b> $NumExecutables</b><br>
-</ul>
+<table>
+<tr><td><b>Item</b></td><td><b>CPU Time</b></td><td><b>Wall Clock</b></td></tr>
+<tr><td>Configure CVS Tree</td><td>$ConfigTime</td><td>$ConfigWallTime</td></tr>
+<tr><td>Build CVS Tree</td><td>$BuildTime</td><td>$BuildWallTime</td></tr>
+<tr><td>Run Feature Tests</td><td>$FeatureTime</td><td>$FeatureWallTime</td></tr>
+<tr><td>Run Regression Tests</td><td>$RegressionTime</td><td>$RegressionWallTime</td></tr>
+</table></li>
+<li>Number of object files compiled: <b>$NumObjects</b></li>
+<li>Number of libraries linked: <b>$NumLibraries</b></li>
+<li>Number of executables linked:<b> $NumExecutables</b></li>
+<li>Build Error: $BuildError</li>
</ul>
<h2>Warnings during the build:</h2>
<li>Newly passing tests: $TestsFixed
<li>Newly failing tests: $TestsBroken
</ul>
-
+</td></tr></tbody></table>
<br><br><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
-<font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
+<font size=+2 face=Verdana><b><a name="Trends">Changes Over Time</font></b>
</td></tr></table></td></tr></table></center><p>
-GNUplot <b>charts</b> showing a couple of things:
-<ol>
-<li>LOC in CVS
-<li>Compile Time
-<li>Testing Time
-<li>Time to run some programs, say all of Olden
-<li>Time to compile something, say Olden.
-<li>Size of bytecode files for Olden
-</ol>
+
+Here are some charts showing how the LLVM optimizer and code generators are
+changing over time. For now we use the Olden benchmark suite to measure this,
+but eventually we will switch to using SPEC CPU2000. All programs are run with
+"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
+version.<p>
+
+<h2>Compilation Measurements:</h2>
+
+<table border="0" align=center>
+<tr>
+<td width=50% align=center>
+<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
+Size of LLVM bytecode files
+</td>
+<td width=50% align=center>
+<a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br>
+Size of native machine code for each program (generated by the JIT)
+</td></tr>
+<tr>
+<td align=center>
+<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
+Time to run the LLVM optimizer on each program
+</td>
+<td></td></tr>
+</table>
+
+<h2>Program Execution Measurements:</h2>
+
+<table border="0" align=center>
+<tr>
+<td width=50% align=center>
+<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
+Execution time for CBE generated executable
+</td>
+<td width=50% align=center>
+<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
+Execution time for the LLC generated executable
+</td></tr>
+
+<tr>
+<td align=center>
+<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
+Execution time for program in the JIT
+</td>
+<td></td></tr>
+</table>
+
+
+
<br><br><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
code generated by the JIT.</li>
<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
- with GCC -O3.</li>
+ with GCC -O2.</li>
<li><a name="CBE">CBE</a> - The time taken to execute the program after
- compilation through the C Backend.</li>
+ compilation through the C backend, compiled with -O2.</li>
<li><a name="LLC">LLC</a> - How long does the program generated by the static
backend LLC take to execute </li>
<li><a name="JIT">JIT</a> - The amount of time spent running the
program with the JIT; this includes the code generation phase (listed above)
and actually running the program.</li>
+<li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
+<li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native
+ GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
+<li><a name="LLC-LS">LLC-LS</a> - How long does the program generated by the static
+ backend LLC take to execute the program, when compiled with the linear scan
+ register allocator. This is temporary, for tuning.</li>
</ol><p>
-A complete log of testing <a href="$DATE-ProgramTest.txt.gz">is available</a>
-for further analysis.
+A complete log of testing
+<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
+<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
+<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
+available for further analysis.
+
+<h2>Programs/External</h2>
+
+<center>
+<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
+$ExternalProgramsTable
+</td></tr></table></center>
<h2>Programs/MultiSource</h2>
<center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
-$ProgramsTable
+$MultiSourceProgramsTable
</td></tr></table></center>
<h2>Programs/SingleSource</h2>
+<center>
+<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
+$SingleSourceProgramsTable
+</td></tr></table></center>
+
-<br><br><center>
+<br/><br/><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
-<font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
-</td></tr></table></td></tr></table></center><p>
+<font size=+2 face=Verdana><b><a name="Feature">Feature Test Results</font></b>
+</td></tr></table></td></tr></table></center>
+<br/>
+$FeatureTestResults
-Not yet implemented<p>
-
-</td></tr>
+<br/><br/><center>
+<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
+<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
+<font size=+2 face=Verdana><b><a name="Regression">Regression Test Results</font></b>
+</td></tr></table></td></tr></table></center>
+<br/>
+$RegressionTestResults
-</html>
+</td></tr></html>
projects / oota-llvm.git / blobdiff