Update ci script to use pants.pex built from sources rather than a released pants.

Review Request #101 — Created March 13, 2014 and submitted

travis
commons
pants-reviews
lahosken, wickman
Update ci script to use pants.pex built from sources rather than a released pants.
There are still two issues with our CI. I'd like to use pants.pex everywhere and fix these separately as I still need to track down what the issue is.

****************************
SELF DISTRIBUTION TEST FAILS
****************************

Full log: https://gist.github.com/traviscrawford/5f0676449b8f22224b52

Error:
[== Running pants distribution tests ==]
 
Build operating on targets: OrderedSet([PythonBinary(src/python/twitter/pants/BUILD.transitional:_pants_transitional_publishable_binary_)])
Building PythonBinary PythonBinary(src/python/twitter/pants/BUILD.transitional:_pants_transitional_publishable_binary_):
Problem executing PythonBuilder for targets OrderedSet([PythonBinary(src/python/twitter/pants/BUILD.transitional:_pants_transitional_publishable_binary_)]): Traceback (most recent call last):
  File "/Users/travis/src/commons/pants.pex/twitter/pants/commands/build.py", line 126, in _python_build
    conn_timeout=self.options.conn_timeout)
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/python_builder.py", line 61, in build
    conn_timeout=conn_timeout).run()
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/binary_builder.py", line 65, in run
    env = self.chroot.dump()
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/python_chroot.py", line 201, in dump
    platforms=platforms)
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/resolver.py", line 120, in resolve_multi
    distributions[platform] = working_set.resolve(requirements, env=env, installer=installer)
  File "/Users/travis/src/commons/pants.pex/.bootstrap/pkg_resources.py", line 592, in resolve
    raise VersionConflict(dist,req) # XXX put more info here
VersionConflict: (setuptools 3.1 (/Users/travis/src/commons/.pants.d/python/eggs/setuptools-3.1-py2.6.egg), PythonRequirement(setuptools==2.1.2))
 

***************************************
PYTHON TESTS FAIL WITH SETUPTOOLS ERROR
***************************************

If you skip distribution tests, on some machines we get this error.

Full log: https://gist.github.com/traviscrawford/62c9df8d5f808aad3650

Error:
Failed to install stderr:
Traceback (most recent call last):
  File "<stdin>", line 4, in <module>
  File "setup.py", line 2, in <module>
    from setuptools import setup
ImportError: No module named setuptools
 
Failed to run test!
Traceback (most recent call last):
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/test_builder.py", line 204, in _run_python_test
    builder = chroot.dump()
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/python_chroot.py", line 169, in dump
    self.MEMOIZED_THRIFTS[thr] = self._generate_thrift_requirement(thr)
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/python_chroot.py", line 140, in _generate_thrift_requirement
    return self._generate_requirement(library, PythonThriftBuilder)
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/python_chroot.py", line 131, in _generate_requirement
    sdist = builder.build(interpreter=self._interpreter)
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/code_generator.py", line 103, in build
    return SdistBuilder.build(self.sdist_root, self.target, interpreter=interpreter)
  File "/Users/travis/Python/CPython-2.6.8/lib/python2.6/site-packages/twitter/pants/python/sdist_builder.py", line 41, in build
    raise cls.SetupError(str(e))
SetupError: Failed to install /Users/travis/src/commons/dist/py-scribe.P721y8/codegen.f2pcy_
LA
  1. oh yeah
  2. 
      
TR
Review request changed

Status: Closed (submitted)

Loading...