about summary refs log tree commit diff
path: root/src/bootstrap/build
AgeCommit message (Collapse)AuthorLines
2016-04-02Auto merge of #32598 - alexcrichton:rustbuild-osx, r=aturonbors-6/+24
rustbuild: Fix compile on OSX for 10.7 This commit should help configure our OSX rustbuild builder for targeting 10.7. A key part of this is using `libc++` instead of `libstdc++` as apparently it's more filled out and otherwise LLVM's cmake configuration would fail.
2016-04-01rustbuild: Fix dist for non-host targetsAlex Crichton-14/+97
The `rust-std` package that we produce is expected to have not only the standard library but also libtest for compiling unit tests. Unfortunately this does not currently happen due to the way rustbuild is structured. There are currently two main stages of compilation in rustbuild, one for the standard library and one for the compiler. This is primarily done to allow us to fill in the sysroot right after the standard library has finished compiling to continue compiling the rest of the crates. Consequently the entire compiler does not have to explicitly depend on the standard library, and this also should allow us to pull in crates.io dependencies into the build in the future because they'll just naturally build against the std we just produced. These phases, however, do not represent a cross-compiled build. Target-only builds also require libtest, and libtest is currently part of the all-encompassing "compiler build". There's unfortunately no way to learn about just libtest and its dependencies (in a great and robust fashion) so to ensure that we can copy the right artifacts over this commit introduces a new build step, libtest. The new libtest build step has documentation, dist, and link steps as std/rustc already do. The compiler now depends on libtest instead of libstd, and all compiler crates can now assume that test and its dependencies are implicitly part of the sysroot (hence explicit dependencies being removed). This makes the build a tad less parallel as in theory many rustc crates can be compiled in parallel with libtest, but this likely isn't where we really need parallelism either (all the time is still spent in the compiler). All in all this allows the `dist-std` step to depend on both libstd and libtest, so `rust-std` packages produced by rustbuild should start having both the standard library and libtest. Closes #32523
2016-03-29rustbuild: Fix compile on OSX for 10.7Alex Crichton-6/+24
This commit should help configure our OSX rustbuild builder for targeting 10.7. A key part of this is using `libc++` instead of `libstdc++` as apparently it's more filled out and otherwise LLVM's cmake configuration would fail.
2016-03-26Revert "disable llvm assertions on ARM compilers"Björn Steinbrink-6/+1
This reverts commit afbbb74fecb3945336520d1930bd52bed9ed0819.
2016-03-22Introduce 'cargotest' and the check-cargotest buildstepBrian Anderson-0/+22
This is a new suite of tests that verifies that the compiler builds specific revisions of select crates from crates.io. It does not run by default. It is intended that buildbot runs these tests against all PRs, and gate on them.
2016-03-19disable llvm assertions on ARM compilersJorge Aparicio-1/+6
workaround for #32360
2016-03-17rustbuild: Fix cross to netbsd from LinuxAlex Crichton-1/+2
Apparently the NetBSD compiler-rt builds into the linux directory as well. I'm... detecting a trend!
2016-03-16rustbuild: Implement `make dist`Alex Crichton-1/+340
This commit implements the `make dist` command in the new rustbuild build system, porting over `dist.mk` and `prepare.mk` into Rust. There's a huge amount of complexity between those two files, not all of which is likely justified, so the Rust implementation is *much* smaller. Currently the implementation still shells out to rust-installer as well as some python scripts, but ideally we'd rewrite it all in the future to not shell out and be in Rust proper.
2016-03-15Auto merge of #32239 - alexcrichton:fix-cross-to-freebsd, r=brsonbors-1/+2
rustbuild: Fix cross compiling to FreeBSD This commit fixes our support for cross compiling a compiler to run on FreeBSD. Over the weekend I managed to get a cross compiler from Linux to FreeBSD [1] which I hope to soon use to start producing FreeBSD nightly compilers. With the `make dist` support added in #32237 we should be able to produce standard rustc/rust-std packages for FreeBSD through a new slave with this cross compiler. Currently, however, we don't "Just Work" when cross compiling FreeBSD and a number of changes were required (part of this PR). They include: * A few build fixes were needed in LLVM. Our own branch has been rebased on the actual 3.8 release and I applied one extra commit [2] which contains two fixes: 1. The LLVM CMake build system passes the `-Wl,-z,defs` flag on many platforms, but *not* when `CMAKE_SYSTEM_NAME` is "FreeBSD". Unfortunately this doesn't take into account when we're cross compiling, and as predicted the build will fail if `-Wl,-z,defs` is passed (see [3] for more info). To fix this we test `TARGET_TRIPLE` instead of the `CMAKE_SYSTEM_NAME` which is what we're compiling for which fixes the problem. 2. The `PATH_MAX` constant is apparently defined in a different location than many other Unix systems, so a file which required this just needed some help to keep compiling. * Support for compiling compiler-rt with CMake has been added to rustbuild. It looks like it just emulates Linux in what it compiles as it didn't seem to naturally produce anything else... At least the architecture is right, so seems good for now at least! [1]: https://github.com/alexcrichton/port-of-rust/blob/master/prebuilt/freebsd/Dockerfile [2]: https://github.com/rust-lang/llvm/commit/be89e4b5 [3]: https://bugs.webkit.org/show_bug.cgi?id=138420
2016-03-14rustbuild: Fix cross compiling to FreeBSDAlex Crichton-1/+2
This commit fixes our support for cross compiling a compiler to run on FreeBSD. Over the weekend I managed to get a cross compiler from Linux to FreeBSD [1] which I hope to soon use to start producing FreeBSD nightly compilers. With the `make dist` support added in #32237 we should be able to produce standard rustc/rust-std packages for FreeBSD through a new slave with this cross compiler. Currently, however, we don't "Just Work" when cross compiling FreeBSD and a number of changes were required (part of this PR). They include: * A few build fixes were needed in LLVM. Our own branch has been rebased on the actual 3.8 release and I applied one extra commit [2] which contains two fixes: 1. The LLVM CMake build system passes the `-Wl,-z,defs` flag on many platforms, but *not* when `CMAKE_SYSTEM_NAME` is "FreeBSD". Unfortunately this doesn't take into account when we're cross compiling, and as predicted the build will fail if `-Wl,-z,defs` is passed (see [3] for more info). To fix this we test `TARGET_TRIPLE` instead of the `CMAKE_SYSTEM_NAME` which is what we're compiling for which fixes the problem. 2. The `PATH_MAX` constant is apparently defined in a different location than many other Unix systems, so a file which required this just needed some help to keep compiling. * Support for compiling compiler-rt with CMake has been added to rustbuild. It looks like it just emulates Linux in what it compiles as it didn't seem to naturally produce anything else... At least the architecture is right, so seems good for now at least! [1]: https://github.com/alexcrichton/port-of-rust/blob/master/prebuilt/freebsd/Dockerfile [2]: https://github.com/rust-lang/llvm/commit/be89e4b5 [3]: https://bugs.webkit.org/show_bug.cgi?id=138420
2016-03-14rustbuild: Refactor stage arguments awayAlex Crichton-134/+109
The facet of a stage is rarely relevant when running a tool or building something, it's all a question of what stage the *compiler* is built in. We've already got a nice handy `Compiler` structure to carry this information, so let's use it! This refactors the signature of the `Build::cargo` function two ways: 1. The `stage` argument is removed, this was just duplicated with the `compiler` argument's stage field. 2. The `target` argument is now required. This was a bug where if the `--target` flag isn't passed then the snapshot stage0 compiler is always used, so we won't pick up any changes. Much of the other changes in this commit are just propagating these decisions outwards. For example many of the `Step` variants no longer have a stage argument as they're baked into the compiler.
2016-03-14rustbuild: Use tool_cmd() instead of tool()Alex Crichton-6/+3
This sets up the dynamic loader path for dylibs required, so should fix the MSVC build right now.
2016-03-08rustbuild: Add the error-index-generatorAlex Crichton-1/+28
This adds a step and a rule for building the error index as part of rustbuild.
2016-03-08rustbuild: Fix stage1 rustdocAlex Crichton-11/+3
Just always build stage1 rustdoc, it's really not that much more to build as it's essentially just one library.
2016-03-08rustbuild: Add a link checker for documentationAlex Crichton-1/+42
Add a script to get run which verifies that `href` links in documents are correct. We're always getting a steady stream of "fix a broken link" PRs and issue reports, and we should probably just nip them all in the bud.
2016-03-08rustbuild: Fixup calling rustdoc in various stagesAlex Crichton-11/+24
The stage0 rustdoc comes from the snapshot, and we need a shim like with `rustc` to pass `--cfg` for now.
2016-03-08rustbuild: Use an enum to indicate destinationAlex Crichton-43/+61
Instead of using a `is_std: bool`, instead use a more well-typed and self-documenting enum to indicate the mode in which Cargo is being invoked.
2016-03-08rustbuild: Move rustbook to a `src/tools` directoryAlex Crichton-13/+41
We've actually got quite a few tools that are compiled as part of our build, let's start housing them all in a `tools` directory.
2016-03-08rustbuild: Refactor adding steps manuallyAlex Crichton-20/+27
Use a macro so it automatically picks up new steps.
2016-03-08rustbuild: Add crate documentation generationAlex Crichton-4/+59
Run `cargo doc` to generate all documentation for the standard library, and also add a target which generates documentation for the compiler as well (but don't enable it by default).
2016-03-07rustbuild: Add `make check` and a check targetAlex Crichton-0/+12
We'll tack on more steps here later
2016-03-06rustbuild: fix cross compilation of libstd to i686-unknown-linux-muslJorge Aparicio-1/+14
- make sure we copy the third party objects (crt*.o) to the target stage directory. - apply the x86_64-musl logic also to the i686-musl target.
2016-03-03[rustbuild] fix cross compilation of std for mips(el)-linux-muslJorge Aparicio-1/+1
These targets don't link statically to libunwind or libc
2016-03-01Auto merge of #31713 - alexcrichton:rustbuild-docs, r=brsonbors-0/+142
This commit implements documentation generation of the nomicon, the book, the style guide, and the standalone docs. New steps were added for each one as well as appropriate makefile targets for each one as well.
2016-02-28rustbuild: Update nightly dateAlex Crichton-7/+10
Also fix a bug where we didn't clean out previous nightlies
2016-02-28rustbuild: Relax assertions about stage0Alex Crichton-3/+1
This allows bootstrapping new platforms immediately in stage0
2016-02-28rustbuild: Remove extra rustc flagsAlex Crichton-15/+1
These should all no longer be necessary as they've been folded into the compiler.
2016-02-28rustbuild: Add steps for linking a sysrootAlex Crichton-6/+88
When cross compiling for a new host, we can't actually run the host compiler to generate its own libs. In theory, however, all stage2 compilers (for any host) will produce the same libraries, so we just require the build compiler to produce the necessary host libraries and then we link those into place.
2016-02-28rustbuild: Document what steps areAlex Crichton-0/+14
2016-02-28rustbuild: Compile with the build compilerAlex Crichton-2/+2
This switches the defaults to ensure that everything is built with the build compiler rather than the host compiler itself (which we're not guaranteed to be able to run)
2016-02-28rustbuild: Move assembling rustc to its own stepAlex Crichton-18/+20
Right now it's implicitly done as part of building the compiler, but this was intended to be a standalone step to ensure we tracked what built what.
2016-02-28rustbuild: Fix a copy/paste errorAlex Crichton-1/+1
Fixes `--step librustc`
2016-02-28rustbuild: Enable cross-compiling LLVMAlex Crichton-4/+7
Currently all multi-host builds assume the the build platform can run the `llvm-config` binary generated for each host platform we're creating a compiler for. Unfortunately this assumption isn't always true when cross compiling, so we need to handle this case. This commit alters the build script of `rustc_llvm` to understand when it's running an `llvm-config` which is different than the platform we're targeting for.
2016-02-28rustbuild: Fix compiler-rt build on gnueabihfAlex Crichton-0/+8
Needs a different target to get built and also we apparently need to appease the C++ compiler somehow.
2016-02-28rustbuild: Enable bootstrapping new hostsAlex Crichton-7/+4
This commit fixes a longstanding issue with the makefiles where all host platforms bootstrap themselves. This commit alters the build logic for the bootstrap to instead only bootstrap the build triple, and all other compilers are compiled from that one compiler. The benefit of this change is that we can cross-compile compilers which cannot run on the build platform. For example our builders could start creating `arm-unknown-linux-gnueabihf` compilers. This reduces the amount of bootstrapping we do, reducing the amount of test coverage, but overall it should largely just end in faster build times for multi-host compiles as well as enabling a feature which can't be done today. cc #5258
2016-02-20Auto merge of #31620 - alexcrichton:fix-out-of-tree-builds, r=brsonbors-14/+15
This removes creating some extraneous directories and also fixes some submodule management with out of tree builds. Closes #31619
2016-02-16rustbuild: Add rustbook/standalone doc supportAlex Crichton-0/+142
This commit implements documentation generation of the nomicon, the book, the style guide, and the standalone docs. New steps were added for each one as well as appropriate makefile targets for each one as well.
2016-02-12rustbuild: Fix submodules for out of tree buildsAlex Crichton-14/+15
Be sure to put the git command into the right directory when we run the submodule management information. Closes #31619
2016-02-12bootstrap: Be resilient to job object failuresAlex Crichton-2/+13
The build bots already use job objects, and they don't support nested job objects, and we shouldn't entirely bail out in this case anyway!
2016-02-11bootstrap: Add a --clean flagAlex Crichton-0/+44
Also add a `clean` target for the makefiles to blow away everything related to the build. Note that this specifically does not tamper with: * the LLVM build directory * the directory of the bootstrap system * the cached downloads of cargo/rustc
2016-02-11bootstrap: Read configuration from config.mkAlex Crichton-0/+107
During the transition period where we're still using ./configure and makefiles, read some extra configuration from `config.mk` if it's present. This means that the bootstrap build should be configured the same as the original ./configure invocation. Eventually this will all be removed in favor of only storing information in `config.toml` (e.g. the configure script will generate config.toml), but for now this should suffice.
2016-02-11Add a Cargo-based build systemAlex Crichton-0/+1887
This commit is the start of a series of commits which start to replace the makefiles with a Cargo-based build system. The aim is not to remove the makefiles entirely just yet but rather just replace the portions that invoke the compiler to do the bootstrap. This commit specifically adds enough support to perform the bootstrap (and all the cross compilation within) along with generating documentation. More commits will follow up in this series to actually wire up the makefiles to call this build system, so stay tuned!