Opened 13 months ago

Last modified 11 months ago

#5693 assigned task

Make it possible to build modules like FMIL, Blas, Lapack etc standalone

Reported by: aramle Owned by: aramle
Priority: major Milestone:
Component: Build Version: trunk
Keywords: Cc:

Description

It should be easier to build certain modules as standalone both locally and in a Jenkins environment.

Change History (85)

comment:1 Changed 13 months ago by randersson

r11773 Added basic file structure for build of thirdparty dependencies.

comment:2 Changed 13 months ago by randersson

r11778 Renamed previous build.sh to makefile and made some updates to account for new approach regarding what we do in a local versus docker build. Also some new changes in shell scripts and additional entries in default_config.

comment:3 Changed 13 months ago by randersson

r11779 Updated tabs in makefile to be actual tabs \t and not spaces, appears that its a requirement to have when defining targets.

comment:4 Changed 13 months ago by randersson

r11781 Some minor changes to makefile to make it run, still have to update some shell scripts, but this version is "more ok" than previous version.

comment:5 Changed 13 months ago by aramle

r11784 Added configurations for Windows and made pyfmi makefile able to call a general config file.

comment:6 Changed 13 months ago by randersson

r11791 Changes to makefile, updated default config and minor changes to shell scripts. Added shell scripts to extract the ID of the docker image given a specific config.

comment:7 Changed 13 months ago by aramle

r11792 Updated makefile with building pyfmi as wheel and as folder

comment:8 Changed 13 months ago by aramle

r11793 Branching PyFMI to be able to update setup.py

comment:9 Changed 13 months ago by aramle

r11794 Updating setup.py to use setuptools insetad of distutils

comment:10 Changed 13 months ago by aramle

r11797 Updated Makefile.am/in and configs to work with arguments given to setup.py

comment:11 Changed 13 months ago by randersson

r11798 Updates to makefile and some shell scripts, now works to build and call for make targets in a linux environment.

comment:12 Changed 13 months ago by randersson

r11801 Updated shell scripts that installs dependencies and removed old shell scripts that are no longer used. Added script for installing python packages with pip.

comment:13 Changed 13 months ago by randersson

r11807 Additional updates to makefile, removing commas and fixing some of targets.

comment:14 Changed 13 months ago by aramle

r11809 Adding step for building FMIL.

comment:15 Changed 13 months ago by aramle

r11810 Updated makefiles for fmil/pyfmi.

comment:16 Changed 13 months ago by randersson

r11812 Minor change of dependency added to makefile, it now builds FMIL correctly.

comment:17 Changed 13 months ago by aramle

r11816 Created makefile for Assimulo similar to makefile parts of pyfmi.

comment:18 Changed 13 months ago by aramle

r11818 Added structure for ThirdParty builds.

comment:19 Changed 13 months ago by randersson

r11821 Moved parts that build FMIL into FMIL makefile, updated shell scripts to make Dockerfile for base image, added target to pyfmi makefile to create a base image.

Last edited 13 months ago by randersson (previous) (diff)

comment:20 Changed 13 months ago by randersson

r11822 Disabled upgrade pip because it causes a python error "from pip import main error"

comment:21 Changed 13 months ago by randersson

r11827 Commited changes such that it works to build a PyFMI base image.

comment:22 Changed 13 months ago by randersson

r11829 Adding some (template) contents to Jenkinsfile.

comment:23 Changed 13 months ago by randersson

r11831, r11832 fixed typos in Jenkinsfile
r11833 Fixed such that correct branch is checked out on branch.

comment:24 Changed 13 months ago by aramle

r11840 Creating makefiles for blas, lapack, sundials and superlu. Adding windows configurations for these.

comment:25 Changed 12 months ago by aramle

r11844 Adding sketches for groovy files for building pyfmi and assimulo on Jenkins.

comment:26 Changed 12 months ago by aramle

r11845 Updated Jenkinsfile and buildFMILibrary.groovy.

comment:27 Changed 12 months ago by aramle

r11846 Correcting typo.

comment:28 Changed 12 months ago by aramle

r11847 Correcting another typo.

comment:29 Changed 12 months ago by aramle

r11848 - r11850 Correcting more typos.

Last edited 12 months ago by aramle (previous) (diff)

comment:30 Changed 12 months ago by aramle

r11851 Yet another typo.

comment:31 Changed 12 months ago by aramle

r11852 Correcting escaping of JENKINS_BUILD_DIR

comment:32 Changed 12 months ago by aramle

r11853 Yet another typo.
r11855 Removing JM_Home config accidentically committed.

comment:33 Changed 12 months ago by aramle

r11856 Cleaning up paths.

comment:34 Changed 12 months ago by aramle

r11857 Making USER_CONFIG visible again.

comment:35 Changed 12 months ago by aramle

r11858 Correcting archiving.

comment:36 Changed 12 months ago by aramle

r11859, r11860 Fixing unixpath for install.

Last edited 12 months ago by aramle (previous) (diff)

comment:37 Changed 12 months ago by aramle

r11863 Adding build of wheel and fixinf config in buildPyFMI.groovy

comment:38 Changed 12 months ago by aramle

r11864 Restructuring FMIL and PyFMI targets

comment:39 Changed 12 months ago by aramle

r11865 Correcting typo.
r11867 Removing fmil as dependency target for pyfmi_wheel/folder.

comment:40 Changed 12 months ago by aramle

r11868 Made sure to call clean prior to building pyfmi.

comment:41 Changed 12 months ago by aramle

r11873 Restructured Jenkinsfiles.

comment:42 Changed 12 months ago by aramle

r11874 Adding groovy scripts for building Blas, Lapack, Sundials and SuperLU.

comment:43 Changed 12 months ago by aramle

r11875 Correcting typo.

comment:44 Changed 12 months ago by aramle

r11876 Adding clean_install tagret and fixed typo.

comment:45 Changed 12 months ago by aramle

r11879 Fixing missed commit.

comment:46 Changed 12 months ago by aramle

r11880 Refactoring and removing unnecessary files.

comment:47 Changed 12 months ago by aramle

r11881 Refactoring.

comment:48 Changed 12 months ago by aramle

r11886 Fixing a number of minor issues.

comment:49 Changed 12 months ago by aramle

r11893 Updating SDK and fixing lapack config errors.

comment:50 Changed 12 months ago by aramle

r11894 Fixing incorrect install dir.

comment:51 Changed 12 months ago by aramle

r11895 Merged revision(s) 11766-11894 from trunk

comment:52 Changed 12 months ago by aramle

r11897 Adding mkdir of installfolder to pyfmi wheel.

comment:53 Changed 12 months ago by aramle

r11898 Fixing typos in config.

comment:54 Changed 12 months ago by aramle

r11899 Making sure all is done in one command for pyfmi_wheel.

comment:55 Changed 12 months ago by aramle

r11900 Removing extra }

comment:56 Changed 12 months ago by aramle

r11902 Fixing error in superlu configs.

comment:57 Changed 12 months ago by aramle

r11903 Adding specific install folder for superlu.

comment:58 Changed 12 months ago by aramle

r11904 Make sure to create folder to copy to.

comment:59 Changed 12 months ago by aramle

r11907 Updated configs and buildAssimulo.groovy.

comment:60 Changed 12 months ago by aramle

r11908 Clarifying stages for pyfmi and assimulo on Jenkins.

comment:61 Changed 12 months ago by aramle

r11909 Updated sundials to actually build with SuperLU

comment:62 Changed 12 months ago by aramle

r11916 Making sure install dir folder exist for assimulo wheel

comment:63 Changed 12 months ago by aramle

r11917 Changed pegged version of Assimulo.

comment:64 Changed 12 months ago by aramle

r11918 Change to use distutil/setuptools dynamically in PyFMI.

comment:65 Changed 12 months ago by aramle

r11919 Removed need for setting PYTHONPATH in assimulo and pyfmi makefiles. Fixed config errors for PyFMI.

comment:66 Changed 12 months ago by aramle

r11921 Reverted changes to Makefile.am/in for PyFMI due to no longer needed.

comment:67 Changed 12 months ago by aramle

r11922 Trying to avoid copying of .svn folder.

comment:68 Changed 12 months ago by randersson

r11936 Updates of shell scripts used to generate dockerfiles and docker ID (splitting commit of docker related files and files related to entire build system).

comment:69 Changed 12 months ago by randersson

r11937 Updates of shell scripts used to build docker environments for pyfmi and fmil

comment:70 Changed 12 months ago by randersson

r11938 Changes to fmil makefile and default_config, enabling use of docker.

comment:71 Changed 12 months ago by randersson

r11942 Merged parts for building PyFMI in Docker, updated makefile config, added README and exaxmple config. Added python_configs, for windows it is currently empty so doesn't affect it in anyway

comment:72 Changed 12 months ago by aramle

r11945 Some cleanup.

comment:73 Changed 12 months ago by randersson

r11952 Added makefile to build assimulo base image with Docker.

comment:74 Changed 12 months ago by randersson

r11954 Added some debug output to makefile to find issue on jenkins

r11955 Testing hardcoded path because Jenkins doesnt seem to like double backslash

comment:75 Changed 12 months ago by randersson

r11968 Updates to makefile for build assimulo in docker, changed ubuntu to install python 2.7 because it currently doesn't work with 3.6. Minor updates to shell scripts as well, needs to update the part on PyFMI side.

comment:76 Changed 12 months ago by randersson

r11972 Added ls and pwd to makefile for jenkins
r11973 Added missing paths in jenkins config
r11974 Updated path in jenkins config to correctly correspond to the centos path.
r11975 Added jenkins ubuntu config
r11977 Added groovy script and updated python scripts and minor improvements to makefile for assimulo.
r11978 Removed debug code from jenkinsfile
r11979 Added target to generate list of artifacts
r11981 Improved config variable names
r11982 Updates to config and makefile for assimulo docker
r11983 Added missing && \ to makefile
r11988 Additional improvements and cleanup of design in makefile, and shell scripts, added python_version again to hash.

comment:78 Changed 12 months ago by randersson

r11996 A lot of cleanup and improvements to makefile and shell scripts

comment:77 Changed 12 months ago by randersson

r11996 A lot of cleanup and improvements to makefile and shell scripts

comment:78 Changed 12 months ago by randersson

r12005 Changed artifact_list target and name of file containing name of artifacts
r12008 Added missing echo
r12009 Added target for artifact list
r12010 Moved target into build of other target
r12014 Updated Jenkinsfile and groovy script to correctly build archive artifacts assimulo for centos and ubuntu.

comment:79 Changed 12 months ago by randersson

r12015 Updated shell scripts for coming updates of testing the build artifacts of assimulo.

comment:80 Changed 12 months ago by randersson

r12030 Added targets and shell scripts to build and install the wheel and test the wheel for assimulo.

comment:81 Changed 12 months ago by randersson

r12031 Updated jenkins centos config
r12032 Updated modify_permissions target in makefile
r12035 Updated jenkins ubuntu config for building assimulo
r12039 Updates assimulo docker build system to test everything.
r12040 Added check for variables in jenkins configs
r12041 Moved variable check to makefile from config due to make syntax destroying shell scripts.
r12042 Added characters to unused string to satisfy make
r12043 Modified check for variables to new target
r12048 Updated assimulo docker groovy
r12065 A lot of refactoring and improvements of build system for assimulo and other external modules
r12068 Moved files and improved rule target design
r12073 Split docker environment into separate makefile, updated pyfmi build system and configs, minor updates to shell scripts.

comment:82 Changed 12 months ago by randersson

r12074 removed target variable due to capital letters needed to be in path
r12075 Updated jenkins config with new paths
r12076 Added path for fmil to pyfmi config to enable control over dependencies
r12078 Updated path in pyfmi build system
r12079 Added jenkins configs for docker pyfmi and updated test dependencies, added groovy script and made changes to renamed targets
r12080 Updated FMIL groovy
r12081 Updated pyfmi default config due to issues with capital letters
r12082 Removed dependency from target was written twice and removed config
r12083 Added path missing from jenkins config for pyfmi
r12084 Fixed typo and missing content in jenkins config for pyfmi
r12085 Added temporary rename of pyfmi wheel to satisfy pip install
r12086 Removed typo from makefile and installation of lxml which has been moved earlier.
r12087 Updated PyFMI jenkins scripts with now a full build of all parts

comment:83 Changed 11 months ago by randersson

r12089 Moved argument to setup.py to config and changed default value for win64
r12090 Activated openmp in win64 config again.
r12095 Added fix for PyFMI 64 tests on jenkins
r12098 Added -m64 to default config for sundials
r12099 Added wheel version to config and updated makefile
r12100 Updated assimulo peg version to 873
r12102 Added windows tests for assimulo to its groovy script, now working with 64 bit.
r12106 Added possibility to set wheel version of pyfmi as an external argument to setup.py.
r12107 Added wheel version number to pyfmi wheel and removed automatic renaming previously used for testing.
r12109 Removed old rm command added by mistake
r12111 Added an additional dot between version number and stable tag.

comment:84 Changed 11 months ago by Christian Andersson

changeset:12142

Merged changes made in ticket:5693 to PyFMI trunk.

Note: See TracTickets for help on using tickets.