Compiling Condor on Summit - Revision history

Scottcal at 03:24, 23 May 2019

2019-05-23T03:24:09Z

← Older revision		Revision as of 03:24, 23 May 2019
Line 2:		Line 2:

	Summit is a Power PC system, so few, if any, precompiled binaries exist. Additionally, many libraries installed on Summit are in unconventional locations, making linking them in difficult. I found it was simpler to install user-space copies of many of the libraries Condor requires.		Summit is a Power PC system, so few, if any, precompiled binaries exist. Additionally, many libraries installed on Summit are in unconventional locations, making linking them in difficult. I found it was simpler to install user-space copies of many of the libraries Condor requires.

			== Pre-built ==

			A built copy of Condor for Summit, v8.8.2, is available on Summit at /ccs/home/callag/condor-8.8.2-summit.tgz . Feel free to download it. You will probably still have to include many of the dependencies in your LD_LIBRARY_PATH.

	== Steps ==		== Steps ==
Line 31:		Line 35:
	# Running the cmake command created the Makefile for BLAHP. Edit condor-8.8.2/externals/bundles/blahp/1.16.5.1/blahp-prefix/src/blahp/src/Makefile:		# Running the cmake command created the Makefile for BLAHP. Edit condor-8.8.2/externals/bundles/blahp/1.16.5.1/blahp-prefix/src/blahp/src/Makefile:
	## In line 327, add <pre>-I</path/to/globus_toolkit/include</pre>		## In line 327, add <pre>-I</path/to/globus_toolkit/include</pre>
	## In line 502, change <pre>-L/lib</pre> to <pre>-L</path/to/globus_toolkit/lib></pre>. Keep all the -l<library> entries the same.		## In line 502, change <pre>-L/lib</pre> to <pre>-L</path/to/globus_toolkit/lib></pre> Keep all the -l<library> entries the same.
	## In line 503, change it to <pre>-L</path/to/globus_toolkit</pre>		## In line 503, change it to <pre>-L</path/to/globus_toolkit</pre>
	# Run the cmake command again. If you run into issues with includes or libraries, go back to condor-8.8.2/CMakeLists.txt and make changes to the include and library paths to point to them.		# Run the cmake command again. If you run into issues with includes or libraries, go back to condor-8.8.2/CMakeLists.txt and make changes to the include and library paths to point to them.

Scottcal at 03:20, 23 May 2019

2019-05-23T03:20:32Z

← Older revision		Revision as of 03:20, 23 May 2019
Line 27:		Line 27:
	# BLAHP support is required to get glite to compile (which is needed for rvGAHP). I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find blahp it didn't try to install it itself. To force Condor to build BLAHP itself, I did the following:		# BLAHP support is required to get glite to compile (which is needed for rvGAHP). I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find blahp it didn't try to install it itself. To force Condor to build BLAHP itself, I did the following:
	## In condor-8.8.2/externals/bundles/blahp/1.16.5.1/CMakeLists.txt (if this file doesn't exist, run the cmake command down lower and make these changes when the file is created), edit line 28 to say <pre>if ( NOT BLAHP_PROPER )</pre>		## In condor-8.8.2/externals/bundles/blahp/1.16.5.1/CMakeLists.txt (if this file doesn't exist, run the cmake command down lower and make these changes when the file is created), edit line 28 to say <pre>if ( NOT BLAHP_PROPER )</pre>
	## In condor-8.8.2/CMakeCache.txt, line 29, add <pre>~~//Let Condor install BLAHP~~		## In condor-8.8.2/CMakeCache.txt, line 29, add <pre>BLAHP_PROPER:BOOL=OFF</pre>
	BLAHP_PROPER:BOOL=OFF</pre>
	# Run the following command: <pre>(cmake -DUW_BUILD:BOOL=TRUE -D_VERBOSE:BOOL=TRUE -DBUILDID:STRING=SUMMIT -DCLIPPED:BOOL=ON -DWITH_BLAHP:BOOL=TRUE -DWITH_CREAM:BOOL=OFF -DWANT_MAN_PAGES:BOOL=FALSE -DCMAKE_INSTALL_PREFIX:PATH=<path/to/install/dir> && make && make install) 2>&1 \| tee build.log</pre> It will fail when it gets to the blahp build, because it can't find the Globus includes.		# Run the following command: <pre>(cmake -DUW_BUILD:BOOL=TRUE -D_VERBOSE:BOOL=TRUE -DBUILDID:STRING=SUMMIT -DCLIPPED:BOOL=ON -DWITH_BLAHP:BOOL=TRUE -DWITH_CREAM:BOOL=OFF -DWANT_MAN_PAGES:BOOL=FALSE -DCMAKE_INSTALL_PREFIX:PATH=<path/to/install/dir> && make && make install) 2>&1 \| tee build.log</pre> It will fail when it gets to the blahp build, because it can't find the Globus includes.
	# Running the cmake command created the Makefile for BLAHP. Edit condor-8.8.2/externals/bundles/blahp/1.16.5.1/blahp-prefix/src/blahp/src/Makefile:		# Running the cmake command created the Makefile for BLAHP. Edit condor-8.8.2/externals/bundles/blahp/1.16.5.1/blahp-prefix/src/blahp/src/Makefile:

Scottcal at 03:18, 23 May 2019

2019-05-23T03:18:09Z

← Older revision		Revision as of 03:18, 23 May 2019
Line 27:		Line 27:
	# BLAHP support is required to get glite to compile (which is needed for rvGAHP). I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find blahp it didn't try to install it itself. To force Condor to build BLAHP itself, I did the following:		# BLAHP support is required to get glite to compile (which is needed for rvGAHP). I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find blahp it didn't try to install it itself. To force Condor to build BLAHP itself, I did the following:
	## In condor-8.8.2/externals/bundles/blahp/1.16.5.1/CMakeLists.txt (if this file doesn't exist, run the cmake command down lower and make these changes when the file is created), edit line 28 to say <pre>if ( NOT BLAHP_PROPER )</pre>		## In condor-8.8.2/externals/bundles/blahp/1.16.5.1/CMakeLists.txt (if this file doesn't exist, run the cmake command down lower and make these changes when the file is created), edit line 28 to say <pre>if ( NOT BLAHP_PROPER )</pre>
	## In condor-8.8.2/CMakeCache.txt, line 29, add		## In condor-8.8.2/CMakeCache.txt, line 29, add <pre>//Let Condor install BLAHP
	<pre>//Let Condor install BLAHP
	BLAHP_PROPER:BOOL=OFF</pre>		BLAHP_PROPER:BOOL=OFF</pre>
	# Run the following command: <pre>(cmake -DUW_BUILD:BOOL=TRUE -D_VERBOSE:BOOL=TRUE -DBUILDID:STRING=SUMMIT -DCLIPPED:BOOL=ON -DWITH_BLAHP:BOOL=TRUE -DWITH_CREAM:BOOL=OFF -DWANT_MAN_PAGES:BOOL=FALSE -DCMAKE_INSTALL_PREFIX:PATH=<path/to/install/dir> && make && make install) 2>&1 \| tee build.log</pre> It will fail when it gets to the blahp build, because it can't find the Globus includes.		# Run the following command: <pre>(cmake -DUW_BUILD:BOOL=TRUE -D_VERBOSE:BOOL=TRUE -DBUILDID:STRING=SUMMIT -DCLIPPED:BOOL=ON -DWITH_BLAHP:BOOL=TRUE -DWITH_CREAM:BOOL=OFF -DWANT_MAN_PAGES:BOOL=FALSE -DCMAKE_INSTALL_PREFIX:PATH=<path/to/install/dir> && make && make install) 2>&1 \| tee build.log</pre> It will fail when it gets to the blahp build, because it can't find the Globus includes.

Scottcal at 03:17, 23 May 2019

2019-05-23T03:17:39Z

@@ Line 25: / Line 25: @@
 ## On the next line, add <pre>set(CMAKE_LD_FLAGS "${CMAKE_LD_FLAGS} -L<path/to/pcre/lib> -L</path/to/uuid/lib> -L</path/to/globus_toolkit/lib> -L</path/to/munge/lib> -L</path/to/boost/lib>")</pre>
 # Add Globus libraries to your LD_LIBRARY_PATH: <pre>export LD_LIBRARY_PATH=</path/to/globus_toolkit/lib>:$LD_LIBRARY_PATH</pre>
-# BLAHP support is required to get glite to compile (which is needed for rvGAHP).  I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find
+# BLAHP support is required to get glite to compile (which is needed for rvGAHP).  I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find blahp it didn't try to install it itself.  To force Condor to build BLAHP itself, I did the following:

Scottcal: Created page with "This page is to gather notes on compiling Condor on Summit. I compiled v8.8.2 with blahp for glite support. Summit is a Power PC system, so few, if any, precompiled binaries..."

2019-05-23T02:58:07Z

Created page with "This page is to gather notes on compiling Condor on Summit. I compiled v8.8.2 with blahp for glite support. Summit is a Power PC system, so few, if any, precompiled binaries..."

New page

This page is to gather notes on compiling Condor on Summit. I compiled v8.8.2 with blahp for glite support.

Summit is a Power PC system, so few, if any, precompiled binaries exist. Additionally, many libraries installed on Summit are in unconventional locations, making linking them in difficult. I found it was simpler to install user-space copies of many of the libraries Condor requires.

== Steps ==

I compiled this guide after I completed the install, so there's a chance I left something out. These are the steps as I best remember them.

# Download Condor source from the website. I used v8.8.2.
# Unzip the Condor source.
# Load the following modules:
## module load cmake
## module load curl
## module load sqlite
# Install the following dependencies:
## [https://pcre.org/ PCRE]
## [https://sourceforge.net/projects/libuuid/ UUID]
## [http://toolkit.globus.org/toolkit/ Globus Toolkit] (I used 6.0).
## [https://github.com/dun/munge Munge]
## [https://www.boost.org/ Boost]. I installed v1.66, since that's one of the versions Condor seemed to expect in the externals/bundles/boost directory. Note that Summit does have several versions of Boost which can be loaded via modules, but I couldn't get Condor to pick them up correctly.
## I tried to install [http://www.linux-pam.org/ PAM] also, but there seemed to be an error in the autoconf setup and I couldn't build it. I was able to get Condor to build without it.
# Make the following edits to condor-8.8.2/CMakeLists.txt . (If this file doesn't exist, run the cmake command a few steps below, which will create the file). I'm sure there are other ways to get this into cmake, but this seemed to work.
## In line 30, add <pre>set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -I<path/to/pcre/include> -I</path/to/uuid/include> -I</path/to/globus_toolkit/include> -I</path/to/munge/include> -I</path/to/boost/include>")</pre> You may also need to add the path to sqlite3.h, if it's not picked up from the module.
## On the next line, add <pre>set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} <all the entries you added to CMAKE_C_FLAGS>")</pre>
## On the next line, add <pre>set(CMAKE_LD_FLAGS "${CMAKE_LD_FLAGS} -L<path/to/pcre/lib> -L</path/to/uuid/lib> -L</path/to/globus_toolkit/lib> -L</path/to/munge/lib> -L</path/to/boost/lib>")</pre>
# Add Globus libraries to your LD_LIBRARY_PATH: <pre>export LD_LIBRARY_PATH=</path/to/globus_toolkit/lib>:$LD_LIBRARY_PATH</pre>
# BLAHP support is required to get glite to compile (which is needed for rvGAHP). I was unable to get Condor to install blahp using the default configuration. Condor is supposed to initially look for libraries on the system, but when it couldn't find