2 <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
3 <html><head><title>LLVM Test Results for $DateString</title></head>
6 <center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
10 <tr><td valign=top align=center>
12 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
13 <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
14 <font size=+1><b>Sections:</b></font><br>
15 </td></tr><tr><td bgcolor="#FFCC99" align=center>
16 <a href="#Overview">Overview</a><br>
17 <a href="#Changes">Changes</a><br>
18 <a href="#Trends">Trends</a><br>
19 <a href="#Programs">Programs</a><br>
20 <a href="#Regression">Regression</a><br>
21 </td></tr></table></td></tr></table>
24 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
25 <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
26 <font size=+1><b>Previous:</b></font><br>
27 </td></tr><tr><td bgcolor="#FFCC99">
29 </td></tr></table></td></tr></table>
32 <font size=+1><b>Back to:</b></font><br>
33 <a href="..">Test Results</a><br>
34 <a href="../..">LLVM Page</a><p>
39 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
40 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
41 <font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
42 </td></tr></table></td></tr></table></center><p>
44 <h2>CVS Tree Overview:</h2>
46 <li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
48 Time to check out CVS tree: <b>$CVSCheckoutTime</b> seconds<br>
49 Number of directories in CVS: <b>$NumDirsInCVS</b><br>
50 Number of files in CVS: <b>$NumFilesInCVS</b><br>
51 Number of lines of code: <b>$LOC</b></ul>
52 <li><a href="$DATE-Build-Log.txt">Compilation Log</a>
55 Time to configure CVS tree: <b>$ConfigTime</b> seconds
56 (<b>$ConfigWallTime</b> seconds wall time)<br>
57 Time to build CVS tree: <b>$BuildTime</b> seconds
58 (<b>$BuildWallTime</b> seconds wall time)<br>
59 Number of object files compiled: <b>$NumObjects</b><br>
60 Number of libraries linked: <b>$NumLibraries</b><br>
61 Number of executables linked:<b> $NumExecutables</b><br>
65 <h2>Warnings during the build:</h2>
70 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
71 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
72 <font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
73 </td></tr></table></td></tr></table></center><p>
75 <h2>Changes to CVS:</h2>
77 <li>Users who committed to CVS: <b>$UserCommitList</b>
78 <li>Users who updated from CVS: <b>$UserUpdateList</b>
79 <li>Added Files: $AddedFilesList
80 <li>Modified Files: $ModifiedFilesList
81 <li>Removed Files: $RemovedFilesList
84 <h2>Changes to Warnings:</h2>
86 <li>Warnings Added: $WarningsAdded
87 <li>Warnings Removed: $WarningsRemoved
90 <h2>Changes in the test suite:</h2>
92 <li>New Tests: $TestsAdded
93 <li>Removed Tests: $TestsRemoved
94 <li>Newly passing tests: $TestsFixed
95 <li>Newly failing tests: $TestsBroken
99 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
100 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
101 <font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
102 </td></tr></table></td></tr></table></center><p>
104 GNUplot <b>charts</b> showing a couple of things:
109 <li>Time to run some programs, say all of Olden
110 <li>Time to compile something, say Olden.
111 <li>Size of bytecode files for Olden
115 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
116 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
117 <font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
118 </td></tr></table></td></tr></table></center><p>
120 This section tests LLVM on a variety of programs in the test suite. This
121 includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
122 well as a few random programs with test inputs. This section is meant to track
123 how stable LLVM is as a whole. A failure in the execution of any test is marked
124 with an asterisk: `*'. The columns of the tables are:<p>
127 <li><a name="Program">Program</a> - The name of the program for that row.</li>
128 <li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
129 <li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
131 <li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
132 compiled bytecode</li>
133 <li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
134 LLC (the static backend)</li>
135 <li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
136 JIT itself, instead of executing the program.</li>
137 <li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
138 code generated by the JIT.</li>
139 <li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
141 <li><a name="CBE">CBE</a> - The time taken to execute the program after
142 compilation through the C backend, compiled with -O2.</li>
143 <li><a name="LLC">LLC</a> - How long does the program generated by the static
144 backend LLC take to execute </li>
145 <li><a name="JIT">JIT</a> - The amount of time spent running the
146 program with the JIT; this includes the code generation phase (listed above)
147 and actually running the program.</li>
148 <li><a name="GCC/LLC">GCC/LLC - The speed-up of the LLC output vs the native
149 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
152 A complete log of testing <a href="$DATE-ProgramTest.txt.gz">is available</a>
153 for further analysis.
155 <h2>Programs/MultiSource</h2>
158 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
159 $MultiSourceProgramsTable
160 </td></tr></table></center>
162 <h2>Programs/SingleSource</h2>
165 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
166 $SingleSourceProgramsTable
167 </td></tr></table></center>
172 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
173 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
174 <font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
175 </td></tr></table></td></tr></table></center><p>
177 Not yet implemented<p>