Merge lp:~james-w/launchpad/archive-collection into lp:launchpad
- archive-collection
- Merge into devel
Proposed by
James Westby
| Status: | Work in progress |
|---|---|
| Proposed branch: | lp:~james-w/launchpad/archive-collection |
| Merge into: | lp:launchpad |
| Diff against target: |
611 lines (+421/-70) 7 files modified
lib/lp/services/database/collection.py (+3/-3) lib/lp/soyuz/configure.zcml (+13/-0) lib/lp/soyuz/interfaces/archivecollection.py (+70/-0) lib/lp/soyuz/model/archive.py (+17/-64) lib/lp/soyuz/model/archivecollection.py (+86/-0) lib/lp/soyuz/tests/test_archivecollection.py (+220/-0) lib/lp/testing/factory.py (+12/-3) |
| To merge this branch: | bzr merge lp:~james-w/launchpad/archive-collection |
| Related bugs: |
| Reviewer | Review Type | Date Requested | Status |
|---|---|---|---|
| Launchpad code reviewers | Pending | ||
|
Review via email:
|
|||
Commit message
Description of the change
Hi,
Here's a branch to add an ArchiveCollection based
on the new generic Collection.
It's fairly standalone right now, though I ported a
few easy queries in ArchiveSet methods over to it.
Hopefully once it is available it will see more use.
Thanks,
James
To post a comment you must log in.
Revision history for this message
| Jonathan Lange (jml) wrote : | # |
Revision history for this message
| James Westby (james-w) wrote : | # |
On Mon, 02 Aug 2010 15:58:40 -0000, Jonathan Lange <email address hidden> wrote:
> What's the reason for this change? Where are the corresponding tests?
Sorry, I forgot to mention it in the cover letter.
When you register a Collection as a utility it is instantiated by the
zcml.
However, as the store is queried in the constructor this can fail if
there is not a utility registered for the store yet.
How this manifested was that as soon as I added the utility I could no
longer run any tests as there was an exception during zcml processing.
I'm not sure how I would test this directly? A test that created a
Collection and tested that .store was None?
It does make me realise that I should probably add a test that the
utility returns something sensible?
> In IBranchCollection, we have a *args method for something similar. Do
> you think that would be nicer here?
The implementation is *purposes, so the interface needs correcting.
> Maybe it's my crappy email client, but the indentation on this looks messed up.
It's non-standard as it was copy-paste code, I will fix.
> > + # FIXME: Include private PPA's if user is an uploader
> > + return self.refine(
> > + Or(public_archive, Archive.
> >
>
> Are you going to fix this in this branch? Won't this be buggy if
> someone uses it?
This is copy-paste code, so we apparently have survived this far without
needing it.
I can look at fixing it though.
> These tests are good, thanks.
>
> One thing I've done with similar tests is have a setUp() that removes
> all of the data in question (e.g. removing all branches). That way you
> can do actual equality testing rather than testing to if if objects
> are members in tests.
>
> You don't have to though.
That's a good idea, I'll look for your code to learn from it.
Thanks,
James
Unmerged revisions
- 11270. By James Westby
-
Port a few more easy queries to ArchiveCollection.
- 11269. By James Westby
-
Move the first method over to the new code.
- 11268. By James Westby
-
Add the Interfaces and register a utility for all archives.
Registering a utility means that the zcml processor tries to instantiate
our class, which fails given that the IStoreSelector utility isn't
registered yet. Therefore we lazily get the store in the base Collection
if it isn't in the kwargs in the constructor. - 11267. By James Westby
-
Implement visibleByUser.
- 11266. By James Westby
-
Basic ArchiveCollection implementation.
Preview Diff
[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
| 1 | === modified file 'lib/lp/services/database/collection.py' | |||
| 2 | --- lib/lp/services/database/collection.py 2010-07-16 14:10:18 +0000 | |||
| 3 | +++ lib/lp/services/database/collection.py 2010-08-02 00:41:06 +0000 | |||
| 4 | @@ -68,9 +68,6 @@ | |||
| 5 | 68 | base_tables = list(base.tables) | 68 | base_tables = list(base.tables) |
| 6 | 69 | 69 | ||
| 7 | 70 | self.store = kwargs.get('store') | 70 | self.store = kwargs.get('store') |
| 8 | 71 | if self.store is None: | ||
| 9 | 72 | self.store = getUtility(IStoreSelector).get( | ||
| 10 | 73 | MAIN_STORE, DEFAULT_FLAVOR) | ||
| 11 | 74 | 71 | ||
| 12 | 75 | self.tables = ( | 72 | self.tables = ( |
| 13 | 76 | starting_tables + base_tables + | 73 | starting_tables + base_tables + |
| 14 | @@ -118,6 +115,9 @@ | |||
| 15 | 118 | If no values are requested, this selects the type of object that | 115 | If no values are requested, this selects the type of object that |
| 16 | 119 | the Collection is a collection of. | 116 | the Collection is a collection of. |
| 17 | 120 | """ | 117 | """ |
| 18 | 118 | if self.store is None: | ||
| 19 | 119 | self.store = getUtility(IStoreSelector).get( | ||
| 20 | 120 | MAIN_STORE, DEFAULT_FLAVOR) | ||
| 21 | 121 | if len(self.tables) == 0: | 121 | if len(self.tables) == 0: |
| 22 | 122 | source = self.store | 122 | source = self.store |
| 23 | 123 | else: | 123 | else: |
| 24 | 124 | 124 | ||
| 25 | === modified file 'lib/lp/soyuz/configure.zcml' | |||
| 26 | --- lib/lp/soyuz/configure.zcml 2010-06-30 17:35:36 +0000 | |||
| 27 | +++ lib/lp/soyuz/configure.zcml 2010-08-02 00:41:06 +0000 | |||
| 28 | @@ -67,6 +67,19 @@ | |||
| 29 | 67 | interface="lp.soyuz.interfaces.archivearch.IArchiveArchSet"/> | 67 | interface="lp.soyuz.interfaces.archivearch.IArchiveArchSet"/> |
| 30 | 68 | </securedutility> | 68 | </securedutility> |
| 31 | 69 | 69 | ||
| 32 | 70 | <!-- ArchiveCollection --> | ||
| 33 | 71 | <securedutility | ||
| 34 | 72 | class="lp.soyuz.model.archivecollection.ArchiveCollection" | ||
| 35 | 73 | provides="lp.soyuz.interfaces.archivecollection.IAllArchives"> | ||
| 36 | 74 | <allow | ||
| 37 | 75 | interface="lp.soyuz.interfaces.archivecollection.IAllArchives" /> | ||
| 38 | 76 | </securedutility> | ||
| 39 | 77 | |||
| 40 | 78 | <class class="lp.soyuz.model.archivecollection.ArchiveCollection"> | ||
| 41 | 79 | <allow | ||
| 42 | 80 | interface="lp.soyuz.interfaces.archivecollection.IAllArchives" /> | ||
| 43 | 81 | </class> | ||
| 44 | 82 | |||
| 45 | 70 | <!-- DistroSeriesPackageCache --> | 83 | <!-- DistroSeriesPackageCache --> |
| 46 | 71 | <class | 84 | <class |
| 47 | 72 | class="canonical.launchpad.database.DistroSeriesPackageCache"> | 85 | class="canonical.launchpad.database.DistroSeriesPackageCache"> |
| 48 | 73 | 86 | ||
| 49 | === added file 'lib/lp/soyuz/interfaces/archivecollection.py' | |||
| 50 | --- lib/lp/soyuz/interfaces/archivecollection.py 1970-01-01 00:00:00 +0000 | |||
| 51 | +++ lib/lp/soyuz/interfaces/archivecollection.py 2010-08-02 00:41:06 +0000 | |||
| 52 | @@ -0,0 +1,70 @@ | |||
| 53 | 1 | # Copyright 2010 Canonical Ltd. This software is licensed under the | ||
| 54 | 2 | # GNU Affero General Public License version 3 (see the file LICENSE). | ||
| 55 | 3 | |||
| 56 | 4 | """A collection of archives. | ||
| 57 | 5 | |||
| 58 | 6 | See `IArchiveCollection` for more details. | ||
| 59 | 7 | """ | ||
| 60 | 8 | |||
| 61 | 9 | __metaclass__ = type | ||
| 62 | 10 | __all__ = [ | ||
| 63 | 11 | 'IAllArchives', | ||
| 64 | 12 | 'IArchiveCollection', | ||
| 65 | 13 | ] | ||
| 66 | 14 | |||
| 67 | 15 | from zope.interface import Interface | ||
| 68 | 16 | |||
| 69 | 17 | |||
| 70 | 18 | class IArchiveCollection(Interface): | ||
| 71 | 19 | """A collection of archives. | ||
| 72 | 20 | |||
| 73 | 21 | An `IArchiveCollection` is an immutable collection of archives. | ||
| 74 | 22 | |||
| 75 | 23 | You can use the methods it provides to get a new collection with | ||
| 76 | 24 | a filtered set of archives. | ||
| 77 | 25 | |||
| 78 | 26 | Finally you can call `select` to get a ResultSet from the collection. | ||
| 79 | 27 | """ | ||
| 80 | 28 | |||
| 81 | 29 | def select(*args): | ||
| 82 | 30 | """Return a ResultSet for this collection, with values set to args.""" | ||
| 83 | 31 | |||
| 84 | 32 | def withPurpose(purpose): | ||
| 85 | 33 | """Restrict the archives to only the given purpose.""" | ||
| 86 | 34 | |||
| 87 | 35 | def withPurposes(purposes): | ||
| 88 | 36 | """Restrict the archives to one of the given purposes.""" | ||
| 89 | 37 | |||
| 90 | 38 | def withStatus(status): | ||
| 91 | 39 | """Restrict the archives to only the given status.""" | ||
| 92 | 40 | |||
| 93 | 41 | def withDistribution(distribution): | ||
| 94 | 42 | """Restrict the archives to only the given distribution.""" | ||
| 95 | 43 | |||
| 96 | 44 | def ownedBy(owner): | ||
| 97 | 45 | """Restrict the archives to only those owned by the given person.""" | ||
| 98 | 46 | |||
| 99 | 47 | def withName(name): | ||
| 100 | 48 | """Restrict the archives to only those with the given name.""" | ||
| 101 | 49 | |||
| 102 | 50 | def isEnabled(enabled=True): | ||
| 103 | 51 | """Restrict the archives to only those enabled as passed.""" | ||
| 104 | 52 | |||
| 105 | 53 | def isPrivate(private=True): | ||
| 106 | 54 | """Restrict the archives to only those with the given privacy.""" | ||
| 107 | 55 | |||
| 108 | 56 | def isRequireVirtualized(require_virtualized=True): | ||
| 109 | 57 | """Restrict the archives to those requiring virtualization.""" | ||
| 110 | 58 | |||
| 111 | 59 | def isCommercial(commercial=True): | ||
| 112 | 60 | """Restrict the archives to commercial as given.""" | ||
| 113 | 61 | |||
| 114 | 62 | def visibleByUser(user): | ||
| 115 | 63 | """Restrict the archives to those visible by the given user. | ||
| 116 | 64 | |||
| 117 | 65 | :param user: a Person, or None for public archives. | ||
| 118 | 66 | """ | ||
| 119 | 67 | |||
| 120 | 68 | |||
| 121 | 69 | class IAllArchives(IArchiveCollection): | ||
| 122 | 70 | """An `IArchiveCollection` representing all archives in Launchpad.""" | ||
| 123 | 0 | 71 | ||
| 124 | === modified file 'lib/lp/soyuz/model/archive.py' | |||
| 125 | --- lib/lp/soyuz/model/archive.py 2010-07-27 12:53:24 +0000 | |||
| 126 | +++ lib/lp/soyuz/model/archive.py 2010-08-02 00:41:06 +0000 | |||
| 127 | @@ -40,6 +40,7 @@ | |||
| 128 | 40 | from lp.soyuz.adapters.packagelocation import PackageLocation | 40 | from lp.soyuz.adapters.packagelocation import PackageLocation |
| 129 | 41 | from canonical.launchpad.components.tokens import ( | 41 | from canonical.launchpad.components.tokens import ( |
| 130 | 42 | create_unique_token_for_table) | 42 | create_unique_token_for_table) |
| 131 | 43 | from lp.soyuz.interfaces.archivecollection import IAllArchives | ||
| 132 | 43 | from lp.soyuz.model.archivedependency import ArchiveDependency | 44 | from lp.soyuz.model.archivedependency import ArchiveDependency |
| 133 | 44 | from lp.soyuz.model.archiveauthtoken import ArchiveAuthToken | 45 | from lp.soyuz.model.archiveauthtoken import ArchiveAuthToken |
| 134 | 45 | from lp.soyuz.model.archivesubscriber import ArchiveSubscriber | 46 | from lp.soyuz.model.archivesubscriber import ArchiveSubscriber |
| 135 | @@ -1810,13 +1811,10 @@ | |||
| 136 | 1810 | 1811 | ||
| 137 | 1811 | def getPPAOwnedByPerson(self, person, name=None): | 1812 | def getPPAOwnedByPerson(self, person, name=None): |
| 138 | 1812 | """See `IArchiveSet`.""" | 1813 | """See `IArchiveSet`.""" |
| 143 | 1813 | store = Store.of(person) | 1814 | ppas = getUtility(IAllArchives).withPurpose(ArchivePurpose.PPA) |
| 140 | 1814 | clause = [ | ||
| 141 | 1815 | Archive.purpose == ArchivePurpose.PPA, | ||
| 142 | 1816 | Archive.owner == person] | ||
| 144 | 1817 | if name is not None: | 1815 | if name is not None: |
| 147 | 1818 | clause.append(Archive.name == name) | 1816 | ppas = ppas.withName(name) |
| 148 | 1819 | result = store.find(Archive, *clause).order_by(Archive.id).first() | 1817 | result = ppas.ownedBy(person).select().order_by(Archive.id).first() |
| 149 | 1820 | if name is not None and result is None: | 1818 | if name is not None and result is None: |
| 150 | 1821 | raise NoSuchPPA(name) | 1819 | raise NoSuchPPA(name) |
| 151 | 1822 | return result | 1820 | return result |
| 152 | @@ -1954,79 +1952,34 @@ | |||
| 153 | 1954 | 1952 | ||
| 154 | 1955 | def getPrivatePPAs(self): | 1953 | def getPrivatePPAs(self): |
| 155 | 1956 | """See `IArchiveSet`.""" | 1954 | """See `IArchiveSet`.""" |
| 161 | 1957 | store = getUtility(IStoreSelector).get(MAIN_STORE, DEFAULT_FLAVOR) | 1955 | ppas = getUtility(IAllArchives).withPurpose(ArchivePurpose.PPA) |
| 162 | 1958 | return store.find( | 1956 | return ppas.isPrivate().select() |
| 158 | 1959 | Archive, | ||
| 159 | 1960 | Archive.private == True, | ||
| 160 | 1961 | Archive.purpose == ArchivePurpose.PPA) | ||
| 163 | 1962 | 1957 | ||
| 164 | 1963 | def getCommercialPPAs(self): | 1958 | def getCommercialPPAs(self): |
| 165 | 1964 | """See `IArchiveSet`.""" | 1959 | """See `IArchiveSet`.""" |
| 171 | 1965 | store = IStore(Archive) | 1960 | ppas = getUtility(IAllArchives).withPurpose(ArchivePurpose.PPA) |
| 172 | 1966 | return store.find( | 1961 | return ppas.isCommercial().select() |
| 168 | 1967 | Archive, | ||
| 169 | 1968 | Archive.commercial == True, | ||
| 170 | 1969 | Archive.purpose == ArchivePurpose.PPA) | ||
| 173 | 1970 | 1962 | ||
| 174 | 1971 | def getArchivesForDistribution(self, distribution, name=None, | 1963 | def getArchivesForDistribution(self, distribution, name=None, |
| 175 | 1972 | purposes=None, user=None, | 1964 | purposes=None, user=None, |
| 176 | 1973 | exclude_disabled=True): | 1965 | exclude_disabled=True): |
| 177 | 1974 | """See `IArchiveSet`.""" | 1966 | """See `IArchiveSet`.""" |
| 179 | 1975 | extra_exprs = [] | 1967 | archives = getUtility(IAllArchives).withDistribution(distribution) |
| 180 | 1976 | 1968 | ||
| 181 | 1977 | # If a single purpose is passed in, convert it into a tuple, | ||
| 182 | 1978 | # otherwise assume a list was passed in. | ||
| 183 | 1979 | if purposes in ArchivePurpose: | 1969 | if purposes in ArchivePurpose: |
| 188 | 1980 | purposes = (purposes,) | 1970 | archives = archives.withPurpose(purposes) |
| 189 | 1981 | 1971 | elif purposes: | |
| 190 | 1982 | if purposes: | 1972 | archives = archives.withPurposes(*purposes) |
| 187 | 1983 | extra_exprs.append(Archive.purpose.is_in(purposes)) | ||
| 191 | 1984 | 1973 | ||
| 192 | 1985 | if name is not None: | 1974 | if name is not None: |
| 229 | 1986 | extra_exprs.append(Archive.name == name) | 1975 | archives = archives.withName(name) |
| 230 | 1987 | 1976 | ||
| 231 | 1988 | public_archive = And(Archive.private == False, | 1977 | archives = archives.visibleByUser(user) |
| 196 | 1989 | Archive._enabled == True) | ||
| 197 | 1990 | |||
| 198 | 1991 | if user is not None: | ||
| 199 | 1992 | admins = getUtility(ILaunchpadCelebrities).admin | ||
| 200 | 1993 | if not user.inTeam(admins): | ||
| 201 | 1994 | # Enforce privacy-awareness for logged-in, non-admin users, | ||
| 202 | 1995 | # so that they can only see the private archives that they're | ||
| 203 | 1996 | # allowed to see. | ||
| 204 | 1997 | |||
| 205 | 1998 | # Create a subselect to capture all the teams that are | ||
| 206 | 1999 | # owners of archives AND the user is a member of: | ||
| 207 | 2000 | user_teams_subselect = Select( | ||
| 208 | 2001 | TeamParticipation.teamID, | ||
| 209 | 2002 | where=And( | ||
| 210 | 2003 | TeamParticipation.personID == user.id, | ||
| 211 | 2004 | TeamParticipation.teamID == Archive.ownerID)) | ||
| 212 | 2005 | |||
| 213 | 2006 | # Append the extra expression to capture either public | ||
| 214 | 2007 | # archives, or archives owned by the user, or archives | ||
| 215 | 2008 | # owned by a team of which the user is a member: | ||
| 216 | 2009 | # Note: 'Archive.ownerID == user.id' | ||
| 217 | 2010 | # is unnecessary below because there is a TeamParticipation | ||
| 218 | 2011 | # entry showing that each person is a member of the "team" | ||
| 219 | 2012 | # that consists of themselves. | ||
| 220 | 2013 | |||
| 221 | 2014 | # FIXME: Include private PPA's if user is an uploader | ||
| 222 | 2015 | extra_exprs.append( | ||
| 223 | 2016 | Or(public_archive, | ||
| 224 | 2017 | Archive.ownerID.is_in(user_teams_subselect))) | ||
| 225 | 2018 | else: | ||
| 226 | 2019 | # Anonymous user; filter to include only public archives in | ||
| 227 | 2020 | # the results. | ||
| 228 | 2021 | extra_exprs.append(public_archive) | ||
| 232 | 2022 | 1978 | ||
| 233 | 2023 | if exclude_disabled: | 1979 | if exclude_disabled: |
| 235 | 2024 | extra_exprs.append(Archive._enabled == True) | 1980 | archives = archives.isEnabled() |
| 236 | 2025 | 1981 | ||
| 241 | 2026 | query = Store.of(distribution).find( | 1982 | query = archives.select() |
| 238 | 2027 | Archive, | ||
| 239 | 2028 | Archive.distribution == distribution, | ||
| 240 | 2029 | *extra_exprs) | ||
| 242 | 2030 | 1983 | ||
| 243 | 2031 | return query.order_by(Archive.name) | 1984 | return query.order_by(Archive.name) |
| 244 | 2032 | 1985 | ||
| 245 | 2033 | 1986 | ||
| 246 | === added file 'lib/lp/soyuz/model/archivecollection.py' | |||
| 247 | --- lib/lp/soyuz/model/archivecollection.py 1970-01-01 00:00:00 +0000 | |||
| 248 | +++ lib/lp/soyuz/model/archivecollection.py 2010-08-02 00:41:06 +0000 | |||
| 249 | @@ -0,0 +1,86 @@ | |||
| 250 | 1 | # Copyright 2010 Canonical Ltd. This software is licensed under the | ||
| 251 | 2 | # GNU Affero General Public License version 3 (see the file LICENSE). | ||
| 252 | 3 | |||
| 253 | 4 | __metaclass__ = type | ||
| 254 | 5 | |||
| 255 | 6 | from storm.expr import And, Or, Select | ||
| 256 | 7 | from zope.component import getUtility | ||
| 257 | 8 | from zope.interface import implements | ||
| 258 | 9 | |||
| 259 | 10 | from canonical.launchpad.interfaces.launchpad import ILaunchpadCelebrities | ||
| 260 | 11 | from lp.registry.model.teammembership import TeamParticipation | ||
| 261 | 12 | from lp.services.database.collection import Collection | ||
| 262 | 13 | from lp.soyuz.interfaces.archivecollection import IArchiveCollection | ||
| 263 | 14 | from lp.soyuz.model.archive import Archive | ||
| 264 | 15 | |||
| 265 | 16 | |||
| 266 | 17 | class ArchiveCollection(Collection): | ||
| 267 | 18 | |||
| 268 | 19 | implements(IArchiveCollection) | ||
| 269 | 20 | |||
| 270 | 21 | starting_table = Archive | ||
| 271 | 22 | |||
| 272 | 23 | def withPurpose(self, purpose): | ||
| 273 | 24 | return self.refine(Archive.purpose == purpose) | ||
| 274 | 25 | |||
| 275 | 26 | def withPurposes(self, *purposes): | ||
| 276 | 27 | return self.refine(Archive.purpose.is_in(purposes)) | ||
| 277 | 28 | |||
| 278 | 29 | def withStatus(self, status): | ||
| 279 | 30 | return self.refine(Archive.status == status) | ||
| 280 | 31 | |||
| 281 | 32 | def withDistribution(self, distribution): | ||
| 282 | 33 | return self.refine(Archive.distribution == distribution) | ||
| 283 | 34 | |||
| 284 | 35 | def ownedBy(self, owner): | ||
| 285 | 36 | return self.refine(Archive.owner == owner) | ||
| 286 | 37 | |||
| 287 | 38 | def withName(self, name): | ||
| 288 | 39 | return self.refine(Archive.name == name) | ||
| 289 | 40 | |||
| 290 | 41 | def isEnabled(self, enabled=True): | ||
| 291 | 42 | return self.refine(Archive._enabled == enabled) | ||
| 292 | 43 | |||
| 293 | 44 | def isPrivate(self, private=True): | ||
| 294 | 45 | return self.refine(Archive.private == private) | ||
| 295 | 46 | |||
| 296 | 47 | def isRequireVirtualized(self, require_virtualized=True): | ||
| 297 | 48 | return self.refine(Archive.require_virtualized == require_virtualized) | ||
| 298 | 49 | |||
| 299 | 50 | def isCommercial(self, commercial=True): | ||
| 300 | 51 | return self.refine(Archive.commercial == commercial) | ||
| 301 | 52 | |||
| 302 | 53 | def visibleByUser(self, user): | ||
| 303 | 54 | public_archive = And(Archive.private == False, | ||
| 304 | 55 | Archive._enabled == True) | ||
| 305 | 56 | if user is None: | ||
| 306 | 57 | # Anonymous user; filter to include only public archives in | ||
| 307 | 58 | # the results. | ||
| 308 | 59 | return self.refine(public_archive) | ||
| 309 | 60 | celebs = getUtility(ILaunchpadCelebrities) | ||
| 310 | 61 | if user.inTeam(celebs.admin): | ||
| 311 | 62 | # Admins can see everything | ||
| 312 | 63 | return self | ||
| 313 | 64 | # Enforce privacy-awareness for non-admin users, | ||
| 314 | 65 | # so that they can only see the private archives that they're | ||
| 315 | 66 | # allowed to see. | ||
| 316 | 67 | |||
| 317 | 68 | # Create a subselect to capture all the teams that are | ||
| 318 | 69 | # owners of archives AND the user is a member of: | ||
| 319 | 70 | user_teams_subselect = Select( | ||
| 320 | 71 | TeamParticipation.teamID, | ||
| 321 | 72 | where=And( | ||
| 322 | 73 | TeamParticipation.personID == user.id, | ||
| 323 | 74 | TeamParticipation.teamID == Archive.ownerID)) | ||
| 324 | 75 | |||
| 325 | 76 | # Append the extra expression to capture either public | ||
| 326 | 77 | # archives, or archives owned by the user, or archives | ||
| 327 | 78 | # owned by a team of which the user is a member: | ||
| 328 | 79 | # Note: 'Archive.ownerID == user.id' | ||
| 329 | 80 | # is unnecessary below because there is a TeamParticipation | ||
| 330 | 81 | # entry showing that each person is a member of the "team" | ||
| 331 | 82 | # that consists of themselves. | ||
| 332 | 83 | |||
| 333 | 84 | # FIXME: Include private PPA's if user is an uploader | ||
| 334 | 85 | return self.refine( | ||
| 335 | 86 | Or(public_archive, Archive.ownerID.is_in(user_teams_subselect))) | ||
| 336 | 0 | 87 | ||
| 337 | === added file 'lib/lp/soyuz/tests/test_archivecollection.py' | |||
| 338 | --- lib/lp/soyuz/tests/test_archivecollection.py 1970-01-01 00:00:00 +0000 | |||
| 339 | +++ lib/lp/soyuz/tests/test_archivecollection.py 2010-08-02 00:41:06 +0000 | |||
| 340 | @@ -0,0 +1,220 @@ | |||
| 341 | 1 | # Copyright 2010 Canonical Ltd. This software is licensed under the | ||
| 342 | 2 | # GNU Affero General Public License version 3 (see the file LICENSE). | ||
| 343 | 3 | |||
| 344 | 4 | """Tests for `ArchiveCollection`.""" | ||
| 345 | 5 | |||
| 346 | 6 | __metaclass__ = type | ||
| 347 | 7 | |||
| 348 | 8 | from zope.component import getUtility | ||
| 349 | 9 | from zope.security.proxy import removeSecurityProxy | ||
| 350 | 10 | |||
| 351 | 11 | from canonical.launchpad.interfaces.launchpad import ILaunchpadCelebrities | ||
| 352 | 12 | from canonical.testing import DatabaseFunctionalLayer | ||
| 353 | 13 | from lp.soyuz.interfaces.archive import ArchivePurpose, ArchiveStatus | ||
| 354 | 14 | from lp.soyuz.model.archivecollection import ArchiveCollection | ||
| 355 | 15 | from lp.testing import TestCaseWithFactory | ||
| 356 | 16 | |||
| 357 | 17 | |||
| 358 | 18 | class TestGetPublicationsInArchive(TestCaseWithFactory): | ||
| 359 | 19 | |||
| 360 | 20 | layer = DatabaseFunctionalLayer | ||
| 361 | 21 | |||
| 362 | 22 | def test_baseline(self): | ||
| 363 | 23 | archive = self.factory.makeArchive() | ||
| 364 | 24 | collection = ArchiveCollection() | ||
| 365 | 25 | self.assertIn(archive, collection.select()) | ||
| 366 | 26 | |||
| 367 | 27 | def test_purpose_found(self): | ||
| 368 | 28 | archive = self.factory.makeArchive(purpose=ArchivePurpose.PPA) | ||
| 369 | 29 | collection = ArchiveCollection() | ||
| 370 | 30 | ppas = collection.withPurpose(ArchivePurpose.PPA) | ||
| 371 | 31 | self.assertIn(archive, ppas.select()) | ||
| 372 | 32 | |||
| 373 | 33 | def test_purpose_not_found(self): | ||
| 374 | 34 | archive = self.factory.makeArchive(purpose=ArchivePurpose.PRIMARY) | ||
| 375 | 35 | collection = ArchiveCollection() | ||
| 376 | 36 | ppas = collection.withPurpose(ArchivePurpose.PPA) | ||
| 377 | 37 | self.assertNotIn(archive, ppas.select()) | ||
| 378 | 38 | |||
| 379 | 39 | def test_purposes(self): | ||
| 380 | 40 | archive = self.factory.makeArchive(purpose=ArchivePurpose.PRIMARY) | ||
| 381 | 41 | ppa = self.factory.makeArchive(purpose=ArchivePurpose.PPA) | ||
| 382 | 42 | copy_archive = self.factory.makeArchive(purpose=ArchivePurpose.COPY) | ||
| 383 | 43 | archives = ArchiveCollection().withPurposes( | ||
| 384 | 44 | ArchivePurpose.PPA, ArchivePurpose.COPY) | ||
| 385 | 45 | result = archives.select() | ||
| 386 | 46 | self.assertIn(ppa, result) | ||
| 387 | 47 | self.assertIn(copy_archive, result) | ||
| 388 | 48 | self.assertNotIn(archive, result) | ||
| 389 | 49 | |||
| 390 | 50 | def test_distribution_found(self): | ||
| 391 | 51 | distribution = self.factory.makeDistribution() | ||
| 392 | 52 | archive = self.factory.makeArchive(distribution=distribution) | ||
| 393 | 53 | archives = ArchiveCollection().withDistribution(distribution) | ||
| 394 | 54 | self.assertIn(archive, archives.select()) | ||
| 395 | 55 | |||
| 396 | 56 | def test_distribution_notfound(self): | ||
| 397 | 57 | distribution = self.factory.makeDistribution() | ||
| 398 | 58 | archive = self.factory.makeArchive(distribution=distribution) | ||
| 399 | 59 | other_distribution = self.factory.makeDistribution() | ||
| 400 | 60 | archives = ArchiveCollection().withDistribution(other_distribution) | ||
| 401 | 61 | self.assertNotIn(archive, archives.select()) | ||
| 402 | 62 | |||
| 403 | 63 | def test_owner_found(self): | ||
| 404 | 64 | owner = self.factory.makePerson() | ||
| 405 | 65 | archive = self.factory.makeArchive(owner=owner) | ||
| 406 | 66 | archives = ArchiveCollection().ownedBy(owner) | ||
| 407 | 67 | self.assertIn(archive, archives.select()) | ||
| 408 | 68 | |||
| 409 | 69 | def test_owner_not_found(self): | ||
| 410 | 70 | owner = self.factory.makePerson() | ||
| 411 | 71 | archive = self.factory.makeArchive(owner=owner) | ||
| 412 | 72 | other_person = self.factory.makePerson() | ||
| 413 | 73 | archives = ArchiveCollection().ownedBy(other_person) | ||
| 414 | 74 | self.assertNotIn(archive, archives.select()) | ||
| 415 | 75 | |||
| 416 | 76 | def test_name_found(self): | ||
| 417 | 77 | name = "foo" | ||
| 418 | 78 | archive = self.factory.makeArchive(name=name) | ||
| 419 | 79 | archives = ArchiveCollection().withName(name) | ||
| 420 | 80 | self.assertIn(archive, archives.select()) | ||
| 421 | 81 | |||
| 422 | 82 | def test_name_not_found(self): | ||
| 423 | 83 | name = "foo" | ||
| 424 | 84 | archive = self.factory.makeArchive(name=name) | ||
| 425 | 85 | archives = ArchiveCollection().withName("bar") | ||
| 426 | 86 | self.assertNotIn(archive, archives.select()) | ||
| 427 | 87 | |||
| 428 | 88 | def test_enabled_found(self): | ||
| 429 | 89 | archive = self.factory.makeArchive(enabled=True) | ||
| 430 | 90 | archives = ArchiveCollection().isEnabled() | ||
| 431 | 91 | self.assertIn(archive, archives.select()) | ||
| 432 | 92 | |||
| 433 | 93 | def test_enabled_not_found(self): | ||
| 434 | 94 | archive = self.factory.makeArchive(enabled=True) | ||
| 435 | 95 | archives = ArchiveCollection().isEnabled(False) | ||
| 436 | 96 | self.assertNotIn(archive, archives.select()) | ||
| 437 | 97 | |||
| 438 | 98 | def test_disabled_found(self): | ||
| 439 | 99 | archive = self.factory.makeArchive(enabled=False) | ||
| 440 | 100 | archives = ArchiveCollection().isEnabled(False) | ||
| 441 | 101 | self.assertIn(archive, archives.select()) | ||
| 442 | 102 | |||
| 443 | 103 | def test_disabled_not_found(self): | ||
| 444 | 104 | archive = self.factory.makeArchive(enabled=False) | ||
| 445 | 105 | archives = ArchiveCollection().isEnabled() | ||
| 446 | 106 | self.assertNotIn(archive, archives.select()) | ||
| 447 | 107 | |||
| 448 | 108 | def test_private_found(self): | ||
| 449 | 109 | archive = self.factory.makeArchive(private=True) | ||
| 450 | 110 | archives = ArchiveCollection().isPrivate() | ||
| 451 | 111 | self.assertIn(archive, archives.select()) | ||
| 452 | 112 | |||
| 453 | 113 | def test_private_not_found(self): | ||
| 454 | 114 | archive = self.factory.makeArchive(private=True) | ||
| 455 | 115 | archives = ArchiveCollection().isPrivate(False) | ||
| 456 | 116 | self.assertNotIn(archive, archives.select()) | ||
| 457 | 117 | |||
| 458 | 118 | def test_non_private_found(self): | ||
| 459 | 119 | archive = self.factory.makeArchive(private=False) | ||
| 460 | 120 | archives = ArchiveCollection().isPrivate(False) | ||
| 461 | 121 | self.assertIn(archive, archives.select()) | ||
| 462 | 122 | |||
| 463 | 123 | def test_non_private_not_found(self): | ||
| 464 | 124 | archive = self.factory.makeArchive(private=False) | ||
| 465 | 125 | archives = ArchiveCollection().isPrivate() | ||
| 466 | 126 | self.assertNotIn(archive, archives.select()) | ||
| 467 | 127 | |||
| 468 | 128 | def test_require_virtualized_found(self): | ||
| 469 | 129 | archive = self.factory.makeArchive(virtualized=True) | ||
| 470 | 130 | archives = ArchiveCollection().isRequireVirtualized() | ||
| 471 | 131 | self.assertIn(archive, archives.select()) | ||
| 472 | 132 | |||
| 473 | 133 | def test_require_virtualized_not_found(self): | ||
| 474 | 134 | archive = self.factory.makeArchive(virtualized=True) | ||
| 475 | 135 | archives = ArchiveCollection().isRequireVirtualized(False) | ||
| 476 | 136 | self.assertNotIn(archive, archives.select()) | ||
| 477 | 137 | |||
| 478 | 138 | def test_not_require_virtualized_found(self): | ||
| 479 | 139 | archive = self.factory.makeArchive(virtualized=False) | ||
| 480 | 140 | archives = ArchiveCollection().isRequireVirtualized(False) | ||
| 481 | 141 | self.assertIn(archive, archives.select()) | ||
| 482 | 142 | |||
| 483 | 143 | def test_not_require_virtualized_not_found(self): | ||
| 484 | 144 | archive = self.factory.makeArchive(virtualized=False) | ||
| 485 | 145 | archives = ArchiveCollection().isRequireVirtualized() | ||
| 486 | 146 | self.assertNotIn(archive, archives.select()) | ||
| 487 | 147 | |||
| 488 | 148 | def test_status_found(self): | ||
| 489 | 149 | archive = self.factory.makeArchive(status=ArchiveStatus.ACTIVE) | ||
| 490 | 150 | archives = ArchiveCollection().withStatus(ArchiveStatus.ACTIVE) | ||
| 491 | 151 | self.assertIn(archive, archives.select()) | ||
| 492 | 152 | |||
| 493 | 153 | def test_status_not_found(self): | ||
| 494 | 154 | archive = self.factory.makeArchive(status=ArchiveStatus.ACTIVE) | ||
| 495 | 155 | archives = ArchiveCollection().withStatus(ArchiveStatus.DELETING) | ||
| 496 | 156 | self.assertNotIn(archive, archives.select()) | ||
| 497 | 157 | |||
| 498 | 158 | def test_commercial_found(self): | ||
| 499 | 159 | archive = self.factory.makeArchive(commercial=True) | ||
| 500 | 160 | archives = ArchiveCollection().isCommercial() | ||
| 501 | 161 | self.assertIn(archive, archives.select()) | ||
| 502 | 162 | |||
| 503 | 163 | def test_commercial_not_found(self): | ||
| 504 | 164 | archive = self.factory.makeArchive(commercial=True) | ||
| 505 | 165 | archives = ArchiveCollection().isCommercial(False) | ||
| 506 | 166 | self.assertNotIn(archive, archives.select()) | ||
| 507 | 167 | |||
| 508 | 168 | def test_not_commercial_not_found(self): | ||
| 509 | 169 | archive = self.factory.makeArchive(commercial=False) | ||
| 510 | 170 | archives = ArchiveCollection().isCommercial() | ||
| 511 | 171 | self.assertNotIn(archive, archives.select()) | ||
| 512 | 172 | |||
| 513 | 173 | def test_not_commercial_found(self): | ||
| 514 | 174 | archive = self.factory.makeArchive(commercial=False) | ||
| 515 | 175 | archives = ArchiveCollection().isCommercial(False) | ||
| 516 | 176 | self.assertIn(archive, archives.select()) | ||
| 517 | 177 | |||
| 518 | 178 | def test_admins_can_see_all(self): | ||
| 519 | 179 | archive = self.factory.makeArchive(private=True) | ||
| 520 | 180 | all_archives = ArchiveCollection() | ||
| 521 | 181 | admin = self.factory.makePerson() | ||
| 522 | 182 | admin_team = removeSecurityProxy( | ||
| 523 | 183 | getUtility(ILaunchpadCelebrities).admin) | ||
| 524 | 184 | admin_team.addMember(admin, admin_team.teamowner) | ||
| 525 | 185 | archives = ArchiveCollection().visibleByUser(admin) | ||
| 526 | 186 | self.assertEqual( | ||
| 527 | 187 | sorted(all_archives.select()), sorted(archives.select())) | ||
| 528 | 188 | |||
| 529 | 189 | def test_plain_user_cant_see_private(self): | ||
| 530 | 190 | archive = self.factory.makeArchive(private=True) | ||
| 531 | 191 | person = self.factory.makePerson() | ||
| 532 | 192 | archives = ArchiveCollection().visibleByUser(person) | ||
| 533 | 193 | self.assertNotIn(archive, archives.select()) | ||
| 534 | 194 | |||
| 535 | 195 | def test_plain_user_cant_see_disabled(self): | ||
| 536 | 196 | archive = self.factory.makeArchive(enabled=False, private=False) | ||
| 537 | 197 | person = self.factory.makePerson() | ||
| 538 | 198 | archives = ArchiveCollection().visibleByUser(person) | ||
| 539 | 199 | self.assertNotIn(archive, archives.select()) | ||
| 540 | 200 | |||
| 541 | 201 | def test_plain_user_can_see_public_enabled(self): | ||
| 542 | 202 | archive = self.factory.makeArchive(enabled=True, private=False) | ||
| 543 | 203 | person = self.factory.makePerson() | ||
| 544 | 204 | archives = ArchiveCollection().visibleByUser(person) | ||
| 545 | 205 | self.assertIn(archive, archives.select()) | ||
| 546 | 206 | |||
| 547 | 207 | def test_user_can_see_private_disabled_archives_they_own(self): | ||
| 548 | 208 | person = self.factory.makePerson() | ||
| 549 | 209 | archive = self.factory.makeArchive( | ||
| 550 | 210 | enabled=False, private=True, owner=person) | ||
| 551 | 211 | archives = ArchiveCollection().visibleByUser(person) | ||
| 552 | 212 | self.assertIn(archive, archives.select()) | ||
| 553 | 213 | |||
| 554 | 214 | def test_user_can_see_private_disabled_archives_for_their_teams(self): | ||
| 555 | 215 | person = self.factory.makePerson() | ||
| 556 | 216 | team = self.factory.makeTeam(members=[person]) | ||
| 557 | 217 | archive = self.factory.makeArchive( | ||
| 558 | 218 | enabled=False, private=True, owner=team) | ||
| 559 | 219 | archives = ArchiveCollection().visibleByUser(person) | ||
| 560 | 220 | self.assertIn(archive, archives.select()) | ||
| 561 | 0 | 221 | ||
| 562 | === modified file 'lib/lp/testing/factory.py' | |||
| 563 | --- lib/lp/testing/factory.py 2010-08-01 04:34:26 +0000 | |||
| 564 | +++ lib/lp/testing/factory.py 2010-08-02 00:41:06 +0000 | |||
| 565 | @@ -144,7 +144,7 @@ | |||
| 566 | 144 | 144 | ||
| 567 | 145 | from lp.soyuz.adapters.packagelocation import PackageLocation | 145 | from lp.soyuz.adapters.packagelocation import PackageLocation |
| 568 | 146 | from lp.soyuz.interfaces.archive import ( | 146 | from lp.soyuz.interfaces.archive import ( |
| 570 | 147 | default_name_by_purpose, IArchiveSet, ArchivePurpose) | 147 | default_name_by_purpose, IArchiveSet, ArchivePurpose, ArchiveStatus) |
| 571 | 148 | from lp.soyuz.interfaces.binarypackagebuild import IBinaryPackageBuildSet | 148 | from lp.soyuz.interfaces.binarypackagebuild import IBinaryPackageBuildSet |
| 572 | 149 | from lp.soyuz.interfaces.binarypackagerelease import BinaryPackageFormat | 149 | from lp.soyuz.interfaces.binarypackagerelease import BinaryPackageFormat |
| 573 | 150 | from lp.soyuz.interfaces.component import IComponentSet | 150 | from lp.soyuz.interfaces.component import IComponentSet |
| 574 | @@ -1731,7 +1731,8 @@ | |||
| 575 | 1731 | 1731 | ||
| 576 | 1732 | def makeArchive(self, distribution=None, owner=None, name=None, | 1732 | def makeArchive(self, distribution=None, owner=None, name=None, |
| 577 | 1733 | purpose=None, enabled=True, private=False, | 1733 | purpose=None, enabled=True, private=False, |
| 579 | 1734 | virtualized=True, description=None, displayname=None): | 1734 | virtualized=True, description=None, displayname=None, |
| 580 | 1735 | commercial=False, status=None): | ||
| 581 | 1735 | """Create and return a new arbitrary archive. | 1736 | """Create and return a new arbitrary archive. |
| 582 | 1736 | 1737 | ||
| 583 | 1737 | :param distribution: Supply IDistribution, defaults to a new one | 1738 | :param distribution: Supply IDistribution, defaults to a new one |
| 584 | @@ -1744,6 +1745,8 @@ | |||
| 585 | 1744 | :param private: Whether the archive is created private. | 1745 | :param private: Whether the archive is created private. |
| 586 | 1745 | :param virtualized: Whether the archive is virtualized. | 1746 | :param virtualized: Whether the archive is virtualized. |
| 587 | 1746 | :param description: A description of the archive. | 1747 | :param description: A description of the archive. |
| 588 | 1748 | :param commercial: Whether the archive is commercial. | ||
| 589 | 1749 | :param status: The ArchiveStatus of the archive. | ||
| 590 | 1747 | """ | 1750 | """ |
| 591 | 1748 | if purpose is None: | 1751 | if purpose is None: |
| 592 | 1749 | purpose = ArchivePurpose.PPA | 1752 | purpose = ArchivePurpose.PPA |
| 593 | @@ -1772,11 +1775,17 @@ | |||
| 594 | 1772 | enabled=enabled, require_virtualized=virtualized, | 1775 | enabled=enabled, require_virtualized=virtualized, |
| 595 | 1773 | description=description) | 1776 | description=description) |
| 596 | 1774 | 1777 | ||
| 598 | 1775 | if private: | 1778 | if private or commercial: |
| 599 | 1776 | naked_archive = removeSecurityProxy(archive) | 1779 | naked_archive = removeSecurityProxy(archive) |
| 600 | 1777 | naked_archive.private = True | 1780 | naked_archive.private = True |
| 601 | 1778 | naked_archive.buildd_secret = "sekrit" | 1781 | naked_archive.buildd_secret = "sekrit" |
| 602 | 1779 | 1782 | ||
| 603 | 1783 | if commercial: | ||
| 604 | 1784 | removeSecurityProxy(archive).commercial = True | ||
| 605 | 1785 | |||
| 606 | 1786 | if status is not None: | ||
| 607 | 1787 | removeSecurityProxy(archive).status = status | ||
| 608 | 1788 | |||
| 609 | 1780 | return archive | 1789 | return archive |
| 610 | 1781 | 1790 | ||
| 611 | 1782 | def makeBuilder(self, processor=None, url=None, name=None, title=None, | 1791 | def makeBuilder(self, processor=None, url=None, name=None, title=None, |
On Mon, Aug 2, 2010 at 1:41 AM, James Westby <email address hidden> wrote:
> James Westby has proposed merging lp:~james-w/launchpad/archive-collection into lp:launchpad/devel.
>
> Requested reviews:
> Launchpad code reviewers (launchpad-
>
>
> Hi,
>
> Here's a branch to add an ArchiveCollection based
> on the new generic Collection.
>
> It's fairly standalone right now, though I ported a
> few easy queries in ArchiveSet methods over to it.
> Hopefully once it is available it will see more use.
>
>
Thanks for doing this. It's important to have new code actually be used.
> === modified file 'lib/lp/
> --- lib/lp/
> +++ lib/lp/
> @@ -68,9 +68,6 @@
> base_tables = list(base.tables)
>
> self.store = kwargs.get('store')
> - if self.store is None:
> - self.store = getUtility(
> - MAIN_STORE, DEFAULT_FLAVOR)
>
> self.tables = (
> starting_tables + base_tables +
> @@ -118,6 +115,9 @@
> If no values are requested, this selects the type of object that
> the Collection is a collection of.
> """
> + if self.store is None:
> + self.store = getUtility(
> + MAIN_STORE, DEFAULT_FLAVOR)
> if len(self.tables) == 0:
> source = self.store
> else:
>
What's the reason for this change? Where are the corresponding tests?
> === added file 'lib/lp/
> --- lib/lp/
> +++ lib/lp/
> @@ -0,0 +1,70 @@
> +# Copyright 2010 Canonical Ltd. This software is licensed under the
> +# GNU Affero General Public License version 3 (see the file LICENSE).
> +
> +"""A collection of archives.
> +
...
> +
> + def withPurposes(
> + """Restrict the archives to one of the given purposes."""
In IBranchCollection, we have a *args method for something similar. Do
you think that would be nicer here?
> === added file 'lib/lp/
> --- lib/lp/
> +++ lib/lp/
> @@ -0,0 +1,86 @@
> +# Copyright 2010 Canonical Ltd. This software is licensed under the
> +# GNU Affero General Public License version 3 (see the file LICENSE).
> +
> +__metaclass__ = type
> +
...
> +
> + def visibleByUser(self, user):
> + public_archive = And(Archive.private == False,
> + Archive._enabled == True)
Maybe it's my crappy email client, but the indentation on this looks messed up.
> + if user is None:
> + # Anonymous user; filter to include only public archives in
> + # the results.
> + return self.refine(
> + celebs = getUtility(
> + if user.inTeam(
> + # Admi...