1 <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
2 <html><head><title>LLVM Test Results for $DateString</title></head>
5 <center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
9 <tr><td valign=top align=center>
11 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
12 <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
13 <font size=+1><b>Sections:</b></font><br>
14 </td></tr><tr><td bgcolor="#FFCC99" align=center>
15 <a href="#Overview">Overview</a><br>
16 <a href="#Changes">Changes</a><br>
17 <a href="#Dejagnu">Dejagnu Tests</a><br>
18 <a href="#Trends">Trends</a><br>
19 <a href="#Programs">Programs</a><br>
20 </td></tr></table></td></tr></table>
23 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
24 <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
25 <font size=+1><b>Previous:</b></font><br>
26 </td></tr><tr><td bgcolor="#FFCC99">
28 </td></tr></table></td></tr></table>
31 <font size=+1><b>Back to:</b></font><br>
32 <a href="http://llvm.cs.uiuc.edu/testresults/">Test Results</a><br>
33 <a href="http://llvm.cs.uiuc.edu/">LLVM Page</a><p>
38 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
39 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
40 <font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
41 </td></tr></table></td></tr></table></center><p>
43 <!-- Running LOC graph -->
46 <a href="running_loc_large.png"
47 ><img border=0 width=480 height=360 src="running_loc.png"></a>
49 <tr><td align=center>Lines Of Code over Time<br>
50 <font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
54 <h2>Nightly Test Overview:</h2>
56 <li>Start: <b>$TestStartTime GMT</b></li>
57 <li>Finish: <b>$TestFinishTime GMT</b></li>
58 <li>Platform: <b>$TestPlatform</b></li>
60 <h2>CVS Tree Overview:</h2>
62 <li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
64 <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
65 lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
66 <li><a href="$DATE-Build-Log.txt">Compilation Log</a>
68 <tr><td><b>Item</b></td><td><b>CPU Time</b></td><td><b>Wall Clock</b></td></tr>
69 <tr><td>Configure CVS Tree</td><td>$ConfigTime</td><td>$ConfigWallTime</td></tr>
70 <tr><td>Build CVS Tree</td><td>$BuildTime</td><td>$BuildWallTime</td></tr>
71 <tr><td>Run Dejagnu Tests</td><td>$DejagnuTime</td><td>$DejagnuWallTime</td></tr>
73 <li>Number of object files compiled: <b>$NumObjects</b></li>
74 <li>Number of libraries linked: <b>$NumLibraries</b></li>
75 <li>Number of executables linked:<b> $NumExecutables</b></li>
76 <li>Build Status: $BuildStatus</li>
79 <h2>Warnings during the build:</h2>
84 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
85 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
86 <font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
87 </td></tr></table></td></tr></table></center><p>
89 <h2>Changes to CVS:</h2>
91 <li>Users who committed to CVS: <b>$UserCommitList</b>
92 <li>Users who updated from CVS: <b>$UserUpdateList</b>
93 <li>Added Files: $AddedFilesList
94 <li>Modified Files: $ModifiedFilesList
95 <li>Removed Files: $RemovedFilesList
98 <h2>Changes to Warnings:</h2>
100 <li>Warnings Added: $WarningsAdded
101 <li>Warnings Removed: $WarningsRemoved
104 <h2>Changes in the test suite:</h2>
106 <li>New Tests: $TestsAdded
107 <li>Removed Tests: $TestsRemoved
108 <li>Newly passing tests: $TestsFixed
109 <li>Newly failing tests: $TestsBroken
111 </td></tr></tbody></table>
115 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
116 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
117 <font size=+2 face=Verdana><b><a name="Dejagnu">Dejagnu Test Results</font></b>
118 </td></tr></table></td></tr></table></center>
121 <p>A complete log of testing <a href="$DATE-Dejagnu-testrun.log">Feature and Regression</a> is available for further analysis.</p>
124 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
125 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
126 <font size=+2 face=Verdana><b><a name="Trends">Changes Over Time</font></b>
127 </td></tr></table></td></tr></table></center><p>
130 Here are some charts showing how the LLVM optimizer and code generators are
131 changing over time. For now we use the Olden benchmark suite to measure this,
132 but eventually we will switch to using SPEC CPU2000. All programs are run with
133 "LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
136 <h2>Compilation Measurements:</h2>
138 <table border="0" align=center>
140 <td width=50% align=center>
141 <a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
142 Size of LLVM bytecode files
144 <td width=50% align=center>
145 <a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br>
146 Size of native machine code for each program (generated by the JIT)
150 <a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
151 Time to run the LLVM optimizer on each program
156 <h2>Program Execution Measurements:</h2>
158 <table border="0" align=center>
160 <td width=50% align=center>
161 <a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
162 Execution time for CBE generated executable
164 <td width=50% align=center>
165 <a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
166 Execution time for the LLC generated executable
171 <a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
172 Execution time for program in the JIT
181 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
182 <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
183 <font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
184 </td></tr></table></td></tr></table></center><p>
186 This section tests LLVM on a variety of programs in the test suite. This
187 includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
188 well as a few random programs with test inputs. This section is meant to track
189 how stable LLVM is as a whole. A failure in the execution of any test is marked
190 with an asterisk: `*'. The columns of the tables are:<p>
193 <li><a name="Program">Program</a> - The name of the program for that row.</li>
194 <li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
195 <li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
197 <li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
198 compiled bytecode</li>
199 <li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
200 LLC (the static backend)</li>
201 <li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
202 JIT itself, instead of executing the program.</li>
203 <li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
204 code generated by the JIT.</li>
205 <li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
207 <li><a name="CBE">CBE</a> - The time taken to execute the program after
208 compilation through the C backend, compiled with -O2.</li>
209 <li><a name="LLC">LLC</a> - How long does the program generated by the static
210 backend LLC take to execute </li>
211 <li><a name="JIT">JIT</a> - The amount of time spent running the
212 program with the JIT; this includes the code generation phase (listed above)
213 and actually running the program.</li>
214 <li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native
215 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
216 <li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native
217 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
218 <li><a name="LLC-BETA">LLC-BETA</a> - How long does the program generated by the static
219 backend LLC take to execute the program, when compiled with new experimental
220 features. This is temporary, for tuning.</li>
223 A complete log of testing
224 <a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
225 <a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
226 <a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
227 available for further analysis.
229 <h2>Programs/External</h2>
232 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
233 $ExternalProgramsTable
234 </td></tr></table></center>
236 <h2>Programs/MultiSource</h2>
239 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
240 $MultiSourceProgramsTable
241 </td></tr></table></center>
243 <h2>Programs/SingleSource</h2>
246 <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
247 $SingleSourceProgramsTable
248 </td></tr></table></center>